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CHAPTER 1 


TOWARD A THEORY OF THE OPTIMAL USE OF INTENSITY 
INFORMATION IN THE DETECTION OF LINES IN A 

VISUAL FIELD 

I- INTRODUCTION AND DEFINITIONS 

We are interested in studying procedures which identify 
the images of straight lines in some two-dimensional £ picture-like) 
projection of an array of real objects, given some large set of 
intensity values from points oil the two-dimensional projection 
plane. We? shall confine our attention to arrays of pLane -faced 
solids. Applying a Line-detection procedure to the image of an 
array of Such objects yields a "description' of the objects which 
is, in effect, a line drawing of the objects from a particular 
point ol view. Such a description is complete in the sense that it 


contains, ail information obtainable from that point of view winch is 
relevant to determining the shape, location in space, and so. forth 
Of the objects. Information of the latter Sort, which may be 
regarded as constituting .a mure detailed description of the array 
of objects, may he derived from one or several '’line drawings" 
of a particular array of objects, by methods surveyed, in the last 
chapter ol this pa per- 

In the fj.rsL chapters of thin paper, we sh&il investigate the 
problem of constructing line detection procedures which make 
optimal use of the act ol intensity values to which they are 
applied, by being maximally accurate, in various senses, about 
the lines they claim to exist, Such investigations require a 
formalism, definitions acid so forth, which will presently he 
developed in this section. In the meantime we shall informally 
discuss several considerations relevant to the development of 
such a theory, with the idea of motivating some of the formal 
presentation of the rest of the chapter. 

First, it appears that a theory of optimal edge finding 
procedures would be intractably difficult If we were to consider 
procedures which decide on the locations at which to measure 
each successive intensity value. This leads into the realm of 
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sequential decision procedureei and we should not attempt this 
until we first have a reasonable underatanding of the simpler 
non-sequential case. One may get an idea of the inherent 
complexity nf optimal sequential decision procedures by 
consulting, e. g., Bellman (Bellmar.). For the moment, then, 
we shall assume that the intensities arc obtained from the two- 
dimensional projection of the array of objects in a predetermined 
pattern, such as at the vertices of a grid of squares, and that the 
line finding procedure acts on exactly these intensities. We 
shall return to the problem of sequential analysis of scenes in 
chapter four, where the matter is approached at the heuristic 
level, 

A second assumption to be made concerning the set of 
intensities upon which a lins finding procedure acts concerns 
the relation between the actual intensity at a point in the two 
dimenaional view of the scene and the intensity available to 
the line-finding procedure, which would be obtained bv a real 
optical input device, In general such a device is subject to 
various forms of optical blurring and distortion, as Well as to 
random noise. If there is nothing known about the noise, then 
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the tet nf intensity vaiuCB obtained by Such a device contains no 
information, about the array of objects at hand,, in particular 
about the locations of the projections of their edge lines, U is 
a reasonable assumption that the obtained values of intensity at 
any point be normally distributed about the actual intensity, and 
that the standard deviation of such a distribution be a function 
nf the intensity at the point, [t is further reasonable to assume 
that any s ostial distortion of the intensities be account able for 
principally as some sort of blurring phenomenon. These forms 
of distortion and noise are present in any real optical or eiectro- 
optical system; and certain devices, such as an image-dissector, 
may be designed so that these are the principal effects. 

A third restriction involves- the relation between the size 
of the objects in the scenes under consideration, or more 
properly the si7,e of the images of these objects in a two 
dimensional projection, and the spatial density of points at which 
intenBities are measured. If the intensities are obtained in a 
simple grid pattern with a spacing of one unit on the Image plane, 
it would clearly be impossible to detect edge Lines whose images, 
for example, were shorter than one unit- In judging the 
nptimality of an edge detector, it would surely be unfair to 
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penalize it for not detecting SO Snort a line. A solution to the 
problem might be to consider only arrays of ohjects whose 
images are larger than a certain size relative to the spacing of 
the points at which intensities are measured. An alternative 
approach, which will actually he employed, is as follows; Choose 
a suitable geometry of points in the image space at which to 
measure intensities. Then define a simple predicate an exact 
values of intensity which would be obtained at these points in the 
absence of all noise, distortion and imperfections in the objects 
being examined, Then use this criterion for the existence of a 
line to judge the performance of a line detection procedure which 
measures intensities at the seme points, but with a real optical 
input, device. Ry this means, one is essentially determining how 
well the procedure "sees through" the distortion and noise; and does 
not penalize it for not ''seeing' 1 lines that it could not possibly 
detect from intensities measured at points of the given grid 
even in the absence of noise. 

The concepts so far discussed may be summarized in the 
following definitions. 

Definition; an intensity function, Ifa, y}, is a real-valued 

function whose values and derivatives are defined 
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Definition: 


Definition; 


Definition; 


Definition; 


Definition: 


Definition: 


on a square in 2-space, except for a set of 
measure 0, 

a description space, U, is an arbitrary set of 
elements {dj. 

a sampling set , S, is a finite set □£ points 

f<*i^ I- 

s noise-free sample , !{£), of an intensity function. 
Ilx, y), is the set of values of I{x^ y^l for the 
points (x-p y^J of S* 

a noisy sample , J<S ), is defined as above, but with 
the values of intensity modified by some distortion 
and noiae functions. 

an ideutiiicaLioi : function , F{3), is a mapping from 
a act of intensity functions onto some description 
space, 

F: |lj ->D 

a noise-free sample identification function, GtHij)}, 
is a mapping from a set of noise-free samples onto 
a description space. 

G: {I(£>f -?D 
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Definition: 

a nois¥-&aniDl.e identification function H{ .!(£)), 

is a mapping from a set Of noisy samples to a 

description space, 

H: jj(S)| —>D 

Definition: 

a sample identification function G* together with a 

space of noise-free samples |l(S)| and a description 

space D are said to be descriptively complete with 

respect to an identification function F if 

FtiMi cs>G(I(SH=d. 


This definition describes the situation where all that, one wishes to 
Say about a. Scene may be inferred from the values of intensity at 
a predetermined finite set of locations on the visual field. 


Definition: 

an intensity function E^Cic, y) on a domain A is said 

to be equivalent under the blurring function 

Bto* y) to a function I(x, y) if: 
l#{x,y)= ^ !(«, vj'Biu-x, v-j)du dv 

A 

Definition: 

an intensity function y) is said to be 

Gaussian-noise modulated with respect to an 

intensity function IMx h y) if successive values of 

I**(aE or y 1 distribute normally about I 1 * 4 13f Q „ y^) with. 
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Definition: 


Definition: 


a standard deviation which is dependent solely on 
the value of I-tXg, y^h 

a transducer which goes from an intensity signal 
I(.Xj y) to a Gaussian-noise modulated function 
imni( Sj y) of 3 . function PKx, y) which is equivalent 
under blurring to I(x, y), is called a transducer 
subject to fundamental distortion. 
a scene system with identifiers consists of; 

{l (x, y) \> a act of intensity functions on a common 
domain; 

{(x^y.)! 5 S, a sampling set; 

a set of noise-free samples, one for each 
intensity function 1^; 

■[ |, a set of noisy samples, an infinite number 

of J t isj for each !-(&)♦ The relation between a set 
of J^S) and the corresponding I^S) is entirely 
accountable for by fundamental distortion. 

|d|| - D, a description space; 

F; {l^x.ylj —>D, an identification function; 

G: -S-D, a noise-free sample identification 

flint: 1 ion; 


H: jj.(Sl) -5D, a noisy-sample identification function. 








Finally, for completeness; 


Definition; a scene system with identifiers is said to he 

■descriptively complete if the relevant parts conform 
to the descriptive completeness criterion ahove. 

The various restrictions set forth in the earlier parts of 
tnis section may be simply summarized by saying that we wiU 
concern ourselves exclusively with scene systems with identifiers 
which are descriptively complete, 

IL COMPLETE SYSTEMS OF STRAIGHT-LINE SCENES 

A criterion, for what constitutes a line in a noise -free 
sample will now be given. This definition wiU provide a basis 
for a definition of a line in an intensity function which will he 
appropriate for ensuring completeness. 

Prior to making this definition, however, it is necessary 
to digress slightly to consider a plausible restriction on the 
geometry of the sampling set, An important desideratum of any 
line finder is that it not be especially sensitive to lines in a 
particular part of the field of view, or at any particular 
orientation in the field of view. It may be that of two procedures. 
One will find more lines with a given amount of effort, but at the 


expense of uniformity in this sense. One would still not prefer 
the "hetier" Line finder, on account of its inhomogeneous or 
anisotropis behavior. One thus Wishes to guarantee that any line 
finding procedure that Is a candidate for being considered optimal 
is in addition uniform in ihis sense, A necessary condition seexns 
10 be to have a sampling set which is distributed uniformlu over 
the entire field of view. Without proving this last assertion, we 
shall henceforth restrict our attention to systems whose samoling 
sets consist of points on all vertices of uome grid of squares 
covering the entire field of view. 

A straight line in a noise-free sample over a sampling 
region as described above may he defined in terms of the notions 
of discontinuity and anomaly. We define three such notions 
for, e, g. , a set of coLinear intensities i^, in* and i^ P using 
constants K, K 1 and K' 1 : 

1 ) A discontinuity of intensit y occurs at a point between the 

points at which i 9 and i.^ were obtained if: 

\h - y ^ Kdij - t 2 i + K g - i 4 n. 

2) An ano m alou h j nt.en si z y occurs at the point where Lg 
was obtained if: 

|i 2 - (ij - i 3 W2| > K\ 
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3) 


A discontinuity in shading occurs at a point between 


the points at which i and i were obtained if; 

* 3 

Ittj “ y - fi 3 - i 4 )| > K", 


A line may be defined as two nr more such points, all of the 
same type and all adjacent and col inear. 


It. is now easy to specify a class of systems with identifiers 
which arc descriptively complete in their identification of linos in 
a scene. One may simply choose a scone system with a description 
space appropriate for describing lines, and define a noise-free 
sample identification function G in such a way that it appropriately 
idonLizies all the lines in a noise-free sample according to the above 

definition of a line. One may then define the identification function 
F as follows; 

F(I)=d 1 » G(I(S»-d ir 
The completeness follows a fortiori. 


In whatever system we shall henceforth be considering, we 

shall assume that the description space Is the power set of the set 

of all lines definable as above on noise-free samples. H r e shall 

further assume that the noise=free sample identification function 

of the system is as defined in the previous paragraph. The 

choice of an optimal, noisy-sample identification function for this 

type Of system is the subject of the remainder of this paper. 

IE 


Ill, 


optimization criteria 


The variables to be considered in discussing optimal 
object recognition algorithms are number of intensities read, 
time taken to read each intensity value., length of computation 
time, and rate of error in identifying lines. We wiLl not be 
concerned with, computation time, as this would require more 
knowledge about '"mi mimed 1 versions nf the algorithms concerned 
than is available today. On the other hand, the number of points 
at which intensities are taken, and the Length of time taken in 
getting the intensities can bo related i,n a natural wav to the 
accuracy of identifying and locating lines, or other features 
of a scene. Intuitively, there must exist a trade-off between 
the measurement cost of a certain amount of intensity 
information, and accuracy, measured in terms of number 
of lines correctly' identified. Optimization may consist in 
minimizing some type of error rate, with a fixed overhead 
in effort. One may, alternatively, wish to set a certain 
error rate criterion, and minimize the amount oi effort 
necessary to achieve it. It is easy to see that this latter 
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term of optimization may be reduced to the former; Suppose there 
exists a procedure P{E) which, using E units of effort, minimizes 
the error rate. If it is desired to minimize effort for a fixed 
error rate, one may simply consider all possible instances of 
the procedure P(E) with error rate below the desired one, and 
choose the procedure P(E*) where E* is a minimum among ail 
such amounts of effort. This procedure uses the least possible 
amount of effort while guaranteeing the error rate to be below a 
certain value. We may thus without loss of generality restrict, our 
attention to procedures which make a minimum of errors for a 
given amount of overhead. 

Further discussion of error rate requires a more detailed 
discussion of various types of classification errors and the 
probabilities with which they occur. We shall base this discussion 
on tee notion of false positive error, the assertion by aline finder 
that a line exists at a particular place on the visual field when no 
such line exists in the scene under consideration, and upon the 
converse notion of true negative error,. We will begin with some 
definitions regarding line identification functions. 

Definition; In a system of the type under consideration, for 
some nolse-frcc sample l-{5) and a corresponding 
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noisy pattern JjiSJj we call the set of lines 

the set of false positive errors 
In the identification of the scene from the noisy 
sample 

Definition; For similar conditions, the set Gtlj{£l)-H( 

is called the set of true negative errors in the 
identification of the scent from the noisy sample 
Jj(S). 

Definition; Let A and B be two sets, then the difference 
cardinality, N(A,BK t& the cardinality of the 
sat A-B+ 

It follows immediately that for any J^S) and corresponding 
the number of false positive errors is given by: 

NiHlJ (S)), gki^sdk 

and the number of true negative errors by; 

With the aid of the function N defined above, we may 
indicate the performance of a noisy sample identification function 
in terms of the number of errors of each type it will make in 
describing any particular noisy sample. Before being able to 
indicate the over - all performance of a noisy sample identification 
function* one must as well be able to specify the relative 
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probabilities of occurrence of the various pairs of noise-free end 
noi£_Y samples. For the present we need only the first of the 
following definitions; however they will all ultimately be necessary 


Definition r 

P(1-(S), ls the joint probability of occurrence 

of the noise-free sample I.{&) and. the miay sample 

Definition; 

rUj(S)/l^5}} is the conditional probability that the 

noisy sample J .{£) will occur given the occurrence 

of noise-free sample 

Definition; 

is defined- similarly. 

Definition; 

F(I|(S)L P(Jj(S)} are the a priori probabilities Of 
occurrence of the noise-free sample l i (S> and the 

noisy eample 


Wo may now discuss the expected rate of error of a 
classification System Of the type under consideration. 


Lemma; 

The false-positive error rate, or expected ™imhe r 

of false positive errors made by a complete scene 

ay stem is given by: 

X HUS), J f {£))hl(H(J.(SR 0U,(5)» 

Proof: 

Whenever the noisy sample J.(S) occurs in 

conjunction with the scene representable by 
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the noise -free sample I. (Sh the number of 

false positive errors ie; 

NlHUjfBHpGKl^S))). 

This occurs Vf-ith probability 

P{US>, J.(SJ). QED 
1 ] 

Lemma: The true negative error rate in a similar situation 

is given by: 

X fj tsiimcKysn mj-jfsm, 

the proof is similar. 

With the aid of the following definitions, we may define two- 
add it inn ad error-rate measures; 

Definition- M^A, B), the total number of errors is defined by: 
M(A, B>--NU,BKN(B, A), 

Definition; GtA, BL the identity predicate , is defined by: 

Q{Aj B)= 1 if A a B> 

CKA, B3=0 ifA#B. 

Lemma; The correct recognition rate., or expected rate at 
which a scene is perfectly identified ie given hy 
the following: 

T PUm J.ES)XXOU.iS», 

ti 1 1 1 

the proof is as above. 
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Theorem: 


The total error rate, or expected number of errors 


made by a complete scene system is given by: 

Z F<ys), Jj<S))M(GtS )), 

C j 

the proof is as above* 

As a corrolary to the above theorems, we matte the 
following definitions. 

Definition: a<J J tS) J ^PU i ($}/j ;j (S))N{d. jj GiyS)» 

ia the expected rate of false positive errors on 

occasions when the noisy sample JTS) occurs, 

J" 

provided the description d is assigned to it. 

J 

Definition: d. >= £ J -(SJWfGiljfS)), d.) 

is the expected error rate of true negative errors 
under similar cond.ilions, 

IV. OPTIMIZATION PROCEDURES 

With the aid of the definitions in the previous section, we 
are in a position to discuss four optimization procedures. The 
first involves the maximization of the probability of correctly 
recognizing a scene in its entirety. The second involves 
minimizing tae sum of the false positive and true negative error 
rates* The last two involve the maximization of one of the error 
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rates with the either error rate held cons taut. Since the: & e latter 


two procedures are mathematically nearly equivalent, we shall 
consider only the case of holding the faifie positive error rate 
constant, and minimi Ling the true negative error rate. 

Theorem: The scene recognition procedure which maximizes 

the rate of correct recognition □£ Scene a in their 
entirety is given by the function H(.Tj)-d k such that 

2/XGO^S}), cypu^sh J^S)} 

i 

is maximized. 

Proof: If description d k Is assigned to the noisy sample 

J (S), then a perfect recognition of the Scene will 
occur whenever I^(S), the corresponding state of the 
real world, has the property that G(I i (S)}=d| t . This 
occurs with a probability P(I‘(S)7JJS)) for a particular 
I-(.5) having this property. Hence the expected rate 
uf correct identification for the noisy sample 
T(S) is: 

G<i|<sn=d k 

This is equivalent to: 

J } 1 * 3 GLlii S) )* \ >P( I L < S>/ J (3) ) 
i 

or: 

1 / P(Jj (S » 2 CH G(Ij{ S ) J, d k )Pd t (S }, Jj( S) >. 

i 

3 5 


For a given the rate of correct recognition 

is obtained by maximizing this sum. This 


Theorem: 

optimization: for a particular Jj{S) is independent in 

its effect on optimizing the recognition of other 

JgfS), Hence this noisy-sample-wise optimization 

procedure provides an optimum recognition procedure 

for the set of ail J (S) + 

'Jhc scene recognition procedure which minimi zee 

the rale of false positive errors plus true negative 

errors is given by the function with the 

property that; 

X Mi a I A ( S) L d k }Pf I.( SL j d s» 
i J 

minimized. 

Proof; 

Similar to that of the preceding theorem. 


The last cas<= is a bit more complex. 


Theorem; 

Suppose it is desired to keep the false positive error 

ra^e at or below a constant value a, while minimizing 

the true negative error rate, Then there exists a 

e, depending only on u „ with the property that the 

desired optimality may he achieved tjy assigning to 

J AS) the description d such that 

J K 


ae 


ceCJjfShdJ 4 {l-c)b(J j (S) J d k > 


Proof: 


iti minimal for til d^, 

U There must exist. a description function having 
false positive error rate at or below q. and minimal 
true negative error rate. This follows from the 
fad that, e. g, , = 0 gives a false positive 

J 

error rate of 0. Hence the set of decision functions 
with false positive error rates below a is non-empty. 
There math exist one with minimal true negative 
error rate. Let it be denoted by Hf jj(S)}, and it a 
true negative error rate by /?. 

2) Consider a decision function HHJ {£)! which 
assigns to J AS} the description d^ such that 

■J 

x-aUjlS^K d k ) + (1 -x) btJjfS), d^ 1 is minimal for all 
d in We shall show that for a suitable value c of i, 
the function has a false positive error rate 

at or below a, and a true negative error rate of fi. 
From this it will follow that the function II* (IdS)), 

c ji 

which is the tune Lion referred to in, the theorem, has 
the desired optimality. 
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3 ) Let: 


a{g)=a<jj(S), HtJ^ ( 3 )}), 
b(j>=b(J j(S), H<J f (S)>h and also 
aJti) = a(J..{Sh IIJlJjtSM, 

From the definition of H^jys))* we know that for 
all j* 

5c-a(jJ + U-x) b(g) > + (l-x)>b*(j). 

Multiplying by P{J-(S>) and Humming on j, we have 
j£2 a <i>P(Jj<5» + U-x)^b{j)P(J.t£i>}> 

j ] 

+ U-*)£>£< j>P(J.(S)). 

J J 

Butj by definition, 

Ya(i>F{J.( 5 )> = o, and 

j 1 

Tb(j)P(J.(S)) = fi. 

; ] 

Also* letting 

£a*<j>PlJ (SM = a*, and 

j 3 

JbJCilHJjtSM = p*, 
j 

we have: 

XQ-+ > Xjflf* +fl=* c . 

JK p J£ 

za 


4) It is not difficult to see that x may be choaon so 


as to make £ -,=r = t*. 

X 


This follows by assuming that 


n ^ is a continuous function of x\ and noting that 



achieves a false positive error rate of' CX By simiLar 
reasoning* 0 * increases without bound as x decreELsen 
from 1. Thus for some value e of x the value of 
a* =u£, This approach may be applied to the 
discrete case-, where at leant cr* will be very close 


c 


to Qr The expression of the previous step will then 
reduce tnc 
c a + (l-c)ff > ca + 


c 


But 0 is minimal, and (1 -c) > 0, thus; 



QtD 
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CHAPTER 2 

TILE OPTIMAL USE OF REGIONAL INTENSITY INFORMATION 
IN THE DETECTION OF LINES 

I. THE REGIONAL QUALITY OP ISOLATED LINES 

In this section we shall direct our attention to situations 
where there exist no systematic spatial relationship* among the 
line* appearing in scene* under consideration. We shall hr icily 
discuss the extent to which lines in this case are "regional" in the 
sense that all intensity information relevant to the detection of a 

line is contained on the visual field within a certain short distance 
from the line. 

Definition: Let S be a sampling region consisting of points 

uniformly distributed over a field of view. Let 
FtA.B, 5) be a predicate on intensity values at points 
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of Sp which attempts to decide whether or not there 
is a line segment through points A and Eh Let p 
and jfl respectively be the faLse positive and true 
negative error rates of the function FtAjEpSh 
Then the quantity S^c) is deiined as the smallest 
distance such that there exists a. predicate F^A, Bi 
which decides on the existence of aline through A 
and B only on the basis of intensities of S lying 
within this distance of AB, and which has false 
positive and true negative error rates respectively 
below a+e , and 0+t ■ 

For some small value of t, the value of may take on a 

wide variety of values in different sorts of situations. For example 
5 .(*) would be large in the situation where scenes consist of 

r* 

rectangular parallelapipads. In this case. Lines parallel to a 
proposed Line* or incident With an end, constitute usefuL evidence 
for the existence of the proposed line. The spatial remoteness of 
useful evidence in this case might make 6p(£) not appreciably 
smaller than the radius of the field of view for small values of f - 
However, 6 {«) may he relatively small in the case of scenes 
consisting of single discontinuities of intensity across the field. 
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or of EfltEj of straight lines drawn at random across a sheet of paper, 
A hypothetical situation of particular interest is that in which scenes 
consist of lines which, within a relatively large radius, behave like 
lutes given rise to by edges of plane-faced solids; but which are 
randomly distributed across the field of view. In cases such as 
this, two effects limit the predictive value of intensity information 
remote from a proposed line. 

The first effect has to do with the unpredictibility of 
intensity values away from an edge. In the absence of optical 
distortion and noise, intensities on a line normal to an edge might 
appear as in Figure 2, L + The determination of the existence of an 


intensity' 


HYPOTHETICAL, IDEALIZED 
intensity PROFILE AT 

AN EDGE ai n ) 



± 


x 


0 


X 


Figure 2 . 1 

intensity discontinuity at x ^ is dependent upon finding the right and 
lefL limits of the intensity function at the point x Q . The intensities 
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along the normal away from x^ contain information about the left 
and right limite al However the amount of information contained 
in these intensities fails off as one goes farther from the edge. This 
is due to possible unpredictable non-uniformities in the illumination 
and reflectivity of the objects in the scene. 

The second effect lias to do with the nature of the blurring 
inherent in an optical system. An edge subject to such blurring 
appears as in Figure 2. 2. An abrupt step function is smeared out 

EM TENSITY PROFILE AT AN 



a small disLance from the edge and causes extreme values of the 
various derivatives of the intensity function in a small neighborhood 
of the edge. It is the extreme values of the derivatives that 
characterize and. identify an edge. However, the effect of the 
existence of an edge On the derivatives falls off drastically as one 
goes away from the edge. Hence., derivative information on a Het 
of intensities remote from a possible edge can give little 
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information about the presence or absence of the edge. 

The spatial extent of this effect is determined by the 
critical resolution radius defined as follows T 
Definition: The critical resolution r adius is the radius of a 

circie Whose intensity equals. (I+JJ/2 around the 
image of a point of intensity I on a background of 
intensity ,7. 

fb^ i adius ls related to such factors as the resoLving power nf 
the optics of the system. Empirical evidence suggests that for 
relatively small values of t r the value of BpU) is on the order of 
magnitude of a few times this radius, in the hypothetical case 
mentioned of randomly distributed parallelopiped-edge-like lines. 

!r. situations where the existence of a line Is indeed 
virtually determinable entirely from intensity information contained 
within a few critical radii of the proposed line, we can test for the 
presence of a line in a given location by examining an area which 
could only possibly contain a few other lines resolvable from the 
given line. In general there would seldom he any line but the 
central line in an examined region. This suggests the development 
of a theory nf the optimal use of intensity information within a 
narrow rectangular region, based on a model w r hich assumes the- 
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possible existence of at most one line in the region, 

II* A REGIONAL VERSION OF THE GENERAL THEORY 

A regional version of the theory presented in the previous 
chapter will now he discussed. The theorems presented give rise 
to a procedure which is optimal in deciding on the presence or 
absence of lines within a narrow rectangular region. 

For the theory to be discussed, we adapt the following 
from chapter 1: 

Let {I.tx,. y) | be a set of real valued functions defined 
over a narrow rectangle A. 

Let D = { Oj J | be a two element description space. 

Let S, a sampling set, be a finite subset of R. 

Let F(L(R)l he an Identification function mapping onto D, 
with the inverse image of the element 1_consisting of exactly the 
intensity functions given rise to by lines down the center of R. 

Let G(Ij(S)) be a noise free sample identification function 
such that it and the function F(I^(.RJ) conform to the descriptive 
completeness criterion. In this case, descriptive completeness 
requires that any line identified on R by F{[.(R)J be identifiable 
by GU^<S» from intensities on 5. 


35 


We shall make the following assumptions as well; 

1) That the intensity gathering ■device is subject to 
fundamental distortion, as defined in the previous chapter. 

In particular, we assume that this distortion governs the 
relationship between noisy samples j is), and corresponding 
noise free samples I <S>. 1 

2} That at most one line can occur in the set S T 
Some of these definitions and assumptions will not be explicitly 
used until the next chapter, In particular, the theorem about 
to be proved makes rather little explicit use of them. 

The optimization of the systein in question will, as before, 
be a matter of making optimal use of a series of a priori and 
conditional probabilities in the minimization of certain error rates. 
In particular, we will assume that the a priori probabilities 
P(I^tS) of each noise-free sample together with the 

conditional probabilities PtJj{S)/L(S)J are known; or alternatively 
that the joint probabilities PCJ^CS), L(S)), the product of the previous 
two* are known. Again we. may wish to hold the true negative 
error rate to some value and minimize the false positive error rate; 
hoLd the faise positive error rate to a certain value and minimize 
the true negative error rate; or minimize the sum of the two. 
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A surprising result on]urges from the theorem About to be discussed; 
that these three types of optimization are brought about by 
essentially the same procedure* 

We need the following definition before stating the main 
theorem of this? section* 

Definition: 

QUISH -(2,1) 

Gt I ■($))=! 

This quantity is the probability , given the noisy sample J(5)j that 
there is a line down the center of the region R. 

Theorem: Suppose it is clesired, to keep the false positive error 

rate below a certain value a t and to minimize the true 
negative error rate. Then there exists a ft such that 
the following decision function H(J{5)) satisfies the 
conditions: 

H(J(S))=1<=>Q(J(S)) (2,2) 

Where ft is the minimum value such that: 

2£(l-Q(J|lS»F(J-l5N<a, (2,3) 

Q(J £ {$})>0 

Proof; 1) Suppose a noisy pattern J(S) occurs, and that 

H(J(S))=1, i, e. a line is claimed to exist. Then 
(1-Q(J{S))) is the relative probability of a false 
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punitive &rrnr whenever this pattern J{S) occurs, and 
U-Q(J(S))P(.J(S>) is the absolute probability of a false 
positive error involving the pattern J(S)h Thus: 

ii(.T i <ss>=i 

is- the over-all false positive error rate of the function 
H( J(S)), 

2} It is clear that the value _l_ in place of ^ in 
equation {2. 3-) satisfies it, and that such values are 
hounded below by 0. Hence there exists a least value 
satisfying the equation, which we shall call 
AJso, in the continuous case, for this value of the 
equality of equation (2. 3) will hold. One may 
consider this to be the case as well in the discrete 
case, if the number of discrete values is large, 

3) It remains to show that this procedure gives a 
minimum number ol true negative errors. This error 
rate is given by: 

J^GfJ^SttPCJ^S)) {2. 4) 

H(J i (S)}=0 

Suppose we consider another decision function 
H*(J(S)} satisfying the condition of having false positive 

3S 


error rate equal to or less than p, i r e. 


^{l-OtJtCSjjPtJitSUSa {2,5) 

We wish to show that its true negative error rale 


\b not less than that of H{J(S))> given by expression 
i 2. 4), i. e. that 

^Q(J i (S))P{J i (S)) > ^gUj(S}} p (J:{S)J (2.G) 

H*(J £ {S»-0 H(.J^(S))=0 

4) Let R be the set of i's £. t. and 

H 4: {J i (S))=0 J 

acid let T be the set of i's s. t. fl, and 

1, 

and let U de the aet of i's s.t, HU^SJ^G, and 


H*{J.{S»=O i 


and Let V be the set of i's s.t, H{J.(S))=i, nnd 


Then 


^QU.fSftFUjtSl) = 

H*<J 4 {S)j«0 

JjUJ i C£»P{J,i.S)) + ^(J^SJjRCJdS)), 

u H 
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2!q<j.{s»p(j.<s)> * 

H(J t <S)>=0 

So to prove? { 2 , $)., we need to show; 

JSMJ^SNPtJ^SH > Jjafj.lsHPtJ^sH ( 2 . 7} 

R T 

U i*R, t^nQ<J|(5)} > /3 r and if UT, Q{Jj(S)> c $, so 

Xw^HFU^S)) £ PCJiCSJ) {2, @) 

R R 

and 

^TqU^SUFU.IS)) $ PIJ £ (S», (2, 9) 

T T 

Aasuming equality ill expression (2. 3), we have 

from (2. 3)* {2, 5) and the definition of R a T, and V: 

Xd-QCJ^SHPCJ^SH - > Y(l-Q<J i <S»F<J i <lS», 

RUV TUV 

or, expanding and eliminating the sum on V: 

2]P(Ji<S)> * ^{J.(SJ)P{J^S)) > 

R R 

X.r«(Ji(s)> - ^QU^FiJAsn. 

T T 1 


{2, 10) 


Combining <2.13), (2. y) and (2. 10); 

UflSQ^SJJPtJ^S)) - 2^Q( J t (S»P(J t <SH > 

R R 

5^P(J t (S» - ygCJ^S^PUiCSn^ 

R ' R 

^PtJjtSH - ^QQitsHPOiiS))^ 

T T 

i/$XQ< J i !S >> p < J i< ss > ■ Zo( J i(s))PUi(S)), 

T T 

or; 

c 1 ) 5 jQ<J iCS»PtJjts}) > (1/0-1) ^Qt J^SJJFQ^S)). 

R T 

Formula {2. 7) follows from the fact that (l/0-l) is 
positive, QED 

‘"he u.<i- c: mini mixing 1 the f; = lsr positive- error rate with 
a fixed true negative error rate is almost identical: 

Theorem; Suppose it is desired to keep Hie true negative error 
rate below a certain value a, and to minimize the 
false positive error rate. Then there exists a 0 
such that the following decision function satisfies 
the c-nndfti OTtS: 

H{J(S)M ■=> Q{J(S)>£ 0 . 

Proof: As for the previous theorem. 

It follows- from those two theorems that whatever the value 
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of 0 used, the procedure of thresholding Q(J.{S)) is better than 
all other procedures with the same false positive error rate, 
and better than all other procedures with the same true negative 
error rate. In this respect it is similar to a saddle point a Glut ion 
of classical 2 by 2 game theory. 

It is not difficult to see that this procedure can, for a 
suitable choice of be used to minimise the sum of the two 
error rates. Consider an arbitrary choice procedure which 
gives a false positive error rate a and true negative error 
rate b. Then there exists a ft such that thresholding at 

ft gives false positive error rate & and true negative error rate 
b=n where b* ^ b. This will provide a decision procedure 
whose total error rate is a t b* S a + b. Hence thresholding 
of with this ft gives a minimal sum of error rates. 

III. THE RELATIONSHIP BETWEEN GLOBAL AND 

REGIONAL LINE PREDICATES 

This section discusses the relation between the global 
line finding procedure described in chapter one, and the 
regional procedure of the present chapter. It is clear that the 
procedure of chapter one Is computationally unfeasible. 
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However a systematic application of the regional predicate Id a 
large number of regions on the field of view may be computationally 
practical. The latter procedure- , in certain cases of interest, can 
uot achieve the optimality ol the global procedure* However it 
does trade a certain amount of accuracy for computational 
feasibility. 

It has been pointed out that in certain cases where lines 
on the visual field bear no systematic relationship to each other, 
a regional line predicate of the sort described In the definition 
at the beginning of this chapter seems to be potentially as 
accurate as a global one. It js tempting to formalize this notion 
into some sort of theorem, stating conditions under which a 
systematic application of a regional predicate of this sort to a 
suitably large number of regions on the field is equivalent to a 
global procedure. Unfortunately, an exact correspondence 
between these two procedures is difficult to make. One problem 
is illustrated in Figure 3, 3, It is reasonable to assume that in 
the system described in chapter one, if an element of the 
description apace contains a segment AB, it would not also 
contain a sub segment of that line. More informally stated, the 
scene descriptions Would not Contain, redundant Segments. 
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2 A REGIONAL LINE PREDICATE 

applied to many regions on 

THE FIELD WOULD REPORT LINES 
Ah, AC, . . . , AZ, BC, . .. , HZ, ETC. 
A GLOBAL PROCEDURE WOULD 
OMIT THE SUB-SEGMENTS AND 
REPORT ONLY AZ. 

Figure 2, 3 

On the other hand, the Kyatsmatic application of a regional 
predicate of the sort mentioned would not only give positive 
identification for some complete line in Die scene, but for all 
examined subsegments as well. Another difficulty is that the 
regional predicate might report the existence of tw r o nearly 
coincident lines at very slightly different Inclinations, where 
there is actually only one line. These difficulties will be 
encountered in chapter four, which describes an actual computer 
program embodying a regional line predicate, In the program h 
the problems are handled at the heuristic level. However, from 
a formal point of view, obvious efforts to solve them appear 
artificial. We will thus confine the remainder of this discussion, 
to the informal level. 
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It is convenient to informally divide the evidence relating 
to the existence of a particular line into three categories; 

l) Global evidencej namely evidence from areas spatially 
remote from a possihle line; 

3} Regional evidence* namely evidence from an area 
within a small radius of a possible line; 

3} Local evidence* namely evidence contained within a 
neighborhood of so me point on a possible line. 

It has been pointed out that there are certain problems 
associated with a formal identification of a systematic use of a 
regional predicate with a gLobal predicate. This identification 
appeared plausible uniy in cases where there is no relationship 
among the lines in the figures. However* the situation of 
particular interest is that m which the scenes consist of sets of 
plane -faced solids. In this case there is definitely a relationship 
among the lines in the figures; and a regional predicate cannot 
possibly achieve the optimality of a global one. Figures 2, 4 
and 2. 5 illustrate the possible failures of a regional line 
predicate* which might be avoided by the use of global evidence 
as well as regional evidence. 
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Figure 2, 4 itlust rat es three lines radiating from a common 


DISTINCT LINKS 



LINE IS 
VERY FAINT 


LINE IS FAINT 


B 

</ 


THE REGIONAL PREDICATE APPLIED 
TO "A" INDICATES A LINE DOES NOT 
TRAVERSE THE WHOLE REGION i 
APPLIED TO 11 B M IT IS POSITIVE, 

THIS IGNORES THE GLOBAL 
EVIDENCE PROVIDED BY THE 
"DISTINCT" LINES, WHICH SUGGEST 
THAT THE LINE CONTINUES TO THE 
VERTEX, 


Figure 2, 4 

vertex. The upper two lines are quite distinct, whereas the Lower 
line is faint, especially at the top, A regional predicate applied 
tp region A may claim that aline dues not traverse the entire 
region. However, when applied to E, there is sufficient evidence 
tp claim the existence of a line. The fact that, the line in region B 
"points to" a close vertex Is ignored by the regional predicate. 
Global evidence indicates that the line continues to the vertex. 

The latter Would! likely he the conclusion of a global procedure. 


as discussed in chapter one, which would assign Low plausibility 
(a priori probability) to Scenes with isolated line ends, and high 
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plausibility to closed line figures. Figure 2. 5 illustrates a 

THE REGIONAL PREDICATE 
APPLIED TO "A" MIGHT CLAIM 
THAT THERE IS NO LINE, 

HOWEVER p GI. rOB A ]. EVIDE N C E 
STRONGLY SUGGESTS THERE 
IS, 

Figure 2, a 

situation similar to that in Figure 2.4. In this case a line is 
totally ignored by the regional predicate, despite considerable 
global evidence for its existence. 

In chapter lour, a program will he described which uses 
a regional predicate in the analysis of scenes consisting of 
prismatic Solids. It is convenient to here describe briefly two 
features of Lhis program, as the current context justifies their 
use. Specifically, the two features are designed to overcome 
the noTi-giobaiily of the regional predicate as illustrated by 
the previous two examples. The sort of problem illustrated in 
Figure 2,4 is overcome by the use ol what will be termed links , 
which tentatively extend a line to a possible vertex. The sort of 
problem illustrated in Figure 2. 5 is handled by the procedure of 
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proposing lines. Tine procedure in effect assigns a high a priori 
probability to lines suggested by lines already identified. This 
Lends to augment regional evidence for the proposed line. 

A final fact should be pointed out in this context concerning 
the relationship between the use of purely local evidence and the 
use of a regional predicate. This is analogous to the relationship 
between the systematic use of a regional line finder and the use 
of a global one. In the latter case, it is necessary that the lines 
in the scenes be Spatially independent in order that the two 
procedures be equally effective. In order for purely local decisions 
as to the existence of a line to be as effective as regional decisions, 
it would, by analogy, be necessary that the points along a particular 
line be spatially independent. This is, of course, totally contrary 
to the nature of a line. It is thus quite impossible that a 
systematic application of a simple local decision procedure to a 
suitably large number of neighborhoods covering a region could 
be as sensitive in detecting lines as a regional predicate. By a 
oca: decision procedure" i:-; meant ,l procedure which decides 
entirely On the basis of intensity information from within a 
neighborhood of a point, whether or not a tine traverses the 
neighborhood. The output of such a procedure would be a act of 
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points on the visual field, which would be incorporated into lines 
bv finding maximal sets of adjacent col inear points. 

This two stage procedure is a special case of a set of 
procedures which process intensities in a neighborhood, and then 
process the results for a set of neighborhoods contained within a 
region. Although the particular two Htage procedure mentioned 
in the previous paragraph can never be as sensitive as an Optimal 
regional line finder, there exist two stage procedures of this sort 
which are. This in not surprising, since all regional predicates 
fall into this class, if one regards the first stage to he the 
identity function, and the second stage to be the regional predicate 
itself. There also exist non-trivial examples of members of this 
class which are as sensitive as an optimal regional procedure. 

The procedure described in the next two chapters involves such 
a two stage predicate. Fur the first stage, four values are 
obtained from the intensities in a neighborhood. Sets of these 
four-tuples, obtained from all the neighborhoods within a region, 
are processed by the second stage; and a decision is made as to 
the existence of a line in the region. The procedure may be 
regarded intuitively as extracting all necessary local evidence in 
the first stage, and employing all necessary regional evidence 
in the second stage. 
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chapter 3 


COMPUTATIONAL APPROACHES TO THE REGIONAL THEORY 

L INTRODUCTION 


The object of this chapter is to give a computationally 
feasible method for computing values of the function given by 
Formula 2. 1 of the last chapter; 

Q(J(S>) * ^P(L(S)/j<S». 

It will be recalled that this is a function of the finite set J(S) 
of intensities obtained by a particular sort of optical input 
device from within some region on the field of view. The 
thresholding of this value provides an optimal regional line 
detection procedure, 

Emm B^yes f rule it follows that 




P(J(SK I t <S)> 
P(J(S)) 
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SO that 


Z P(JiS), IdS),) 

Q<J<5» = -‘— 

P(J(S» 

Using the f elation 

PtJ{S)J = ^PIJISU^S)}* 

Gdj(S )>= 1 G(I L (S))-0 

and 

FfJtSU^SU = F’tJ(SUl|{SMF(I 1 {S)), 
we have; 

Q{J(£)) = 

X^J(S»/US)>PtUS» 

G<I i tS»= 1 

GU^Si^l Gd^SM-G 

Sections II and in of this chapter win be concerned with 
the calculation of the values of Sections IV and V 

propose a model for the relative probabilities of the various 
noise-free patterns l^Sh On the basis of the values of 
P(I|{S)) given by the model, it is possible to express the sums 
in the above expression as integrals, and to give a relatively 
simple explicit formula, for In the last section of this 

chapter, this formula Is applied to some simple cases of 
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image-dissector output. 




IL 


NOISE-FREE PATTERNS AND BLURRING DISTORTION 


The value ef the conditional probability is a 

function of the relation between the two sets of intensities 
J. and I.. This relationship tan be decomposed into: 

1) a determinate relation between the noise-free 

sample I and a distorted but noise-free version I*; and 

J j 

2} a simple probabilistic relation between this I* and 

j 

the noisy pattern Jj, 

The former win be discussed in this section: the latter in the 
next section. 

According to the definition of fundamental distortion, 
the relation between a noise-free pattern 1^ and a distorted 
version I* may be expressed in term* of a convolution of the 
former with some function f(x,y), Possible examples of 
f(x,y) are given in Figure 3.1. Theoretic ally, from the way an 



HILL FUNCTION 



PILLBOX FUNCTION 


Figure 3. 1 


53 




image-dissector is deeignedj this function should be eylindrically 
shaped as in the right hand illustration of Figure 1. In faet^ 
it is more like a gaussian "hill" as shown in the left hand 
illustration. An intensity function fix, y) is acted, upon by this 
convolution function ffx, v) to produce a blurred intensity 
function I + y) as follows: 


CD r* 



£E-5SJ 


If we had an edge which is reasonably uniform for a 
relatively long distance compared wiLh the "width 1- of the 
convolution function, we can describe the convolution effect* at 
least locally, by means of a single integral instead of a double 
integral. In particular* suppose for some local region the 
intensity function I{x, y) represents a line parallel to the y-axis, 
Ther locally we may write I(x, y} = I(x} and the corresponding 
blurred but noise-free intensity function I*(x,y) may be 
expressed in this region as: 


sk to 




S3 




Since the inner integral is a function only of u, we may 
indicate it with a singly function name; 


* 


g(u) 


■/ 


ffu, vldv* 


■W 


and we have ax a reasonably extensive and uniform edge 
parallel to the y-axisj 


% 


I*Cx,y) = I*(x) = 


J Ux - tt 


)g<u Mu. 


- 3C 


1) 


We may obtain g(u) empirically by scanning at right angles 
across every narrow line in the visual field. Let the intensity 
along a line normal to a vertical line in the visual field be 
given by: 

I(x) = h if x < -a, x > a 

I(xl - c -a < x < a. 

Then the distorted version nf the intensity locally around the 
line is given by: 


I* Cx> 



lCx-u)g(uJdu 




-x4 a 

"f giu 


Mu 


-x - a 


+ b. 
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= c-a-gf-x), so 


But Lim 
sl ^ 0 


-x+a ■ 
c f g(u)du 


3 fa 


L -Jf-a 


I*i[x} 3 C’a-g(-x) +■ dj 

for very narrow line a. 


Figure 3 .2 shows pLots of intensity taken along normals 



(NEGATED) 

NORMALIZED TO HAVE 1 UNIT = 1/2 500 VIPI FIELD 

SIMILAR AMPLITUDES 


Figure 3, 2 

to various vertical linos. According to the preceding 
paragraph h these curves shouLd be of the form a-g(x) + b. 
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They are shown super imposed and normalized to have similar 
amplitudes. The lines are all quite narrow relative to trie 
width of the hill plotted, and represent lines of a wide variety 
of intensities. The values are all proportional to absolute 
intensity, having been suitably transformed from vidissector 
output which is logarithmic. The degree of variation of 
HO -normalized amplitude was greater than ten to one; and may 
be observed from the relative noisiness of the curves. All 
were recorded at a fixed noise level, and the amount of local 
fluctuation of a given line in the Illustration is a measure of 
the degree to which the hill in question was enlarged in the 
normalisation process, tt should be noted that the shape of 
the curves is remarkably consistent. This indicates a good 
agreement between the theory just discussed and the actual 
behavior of the blurring process In the vidissector. Figure 3. 3 
illustrates a curve obtained from the data in Figure 3, 2 by 
hand fitting. Again, this curve should be of the form 
a*g£x} +- b, where g{x) is the one-dimensional blurring function. 
Also illustrated is a curve of the integral of this function, 
obtained by hand integration. This latter curve will be 
compared with a similar curve obtained by two different methods 
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APPROXIMATIONS TO g{x) AND 
ITS INTEGRAL MAY EE OBTAINED 
EMPIRICALLY FROM THE DATA 
IN FIGURE 3.3 


Fig-urt:- 3, S 
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which will now be described. 


Another approach to finding g(.x> is based on the fad 
that the peak value of an intensity scan normal to a line of 
non-negligible width a is related in a simple way to the integral 


a/2 



-a/2 

namely, if the actual intensity along a normal to a narrow 
vertical line is given by: 

I(x) = c if x c b, s > b + a 

Itx) = c + d b < x < b + a, 

then I*(3cJ. the distorted intensity function is given by: 



{c + Ij^x-u^glujHlu 


where l (x) = 0 except in the interval (b,b*a), where 


I <x) = d, One may write the latter integral as: 



But the former integral is a constant, and the latter integral 


is equal to- 


b+ a-x 


d 


J'giujdu, 


b-x 


and has an extremum at x = l/2(a + b), which is a minimum or 
a maximum depending on the sign of d, At this extremum, the 
integral h&s the value: 


a /2 



-a /£ 

Thus a seam made perpendicular to a line of width a. and 
Intensity c+d on a background of intensity c has a maximum 
(or mini mum) whose value relative to the intensity somewhat 
away from the line is; 


a/ 2 



-a/2 


Suppose a scan iH token across a pair of narrow 
triangles as In the left of Figure 3, 4, In tine figure, 
kLn(l / intensity) is plotted for Successive Scans, In the right 
hand Side of the figure, the values of the maxima of each 
scan minus the background value are plotted for each scan as 
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SCAN LINE? 




INTENSITY PROFILES 


--CURVE 

DERIVED FROM 
INTEGRAL CURVE 
IN FIGURE 3.3 




SOURCE OBJECT 



WIDTH OF LINE SCANNED 
1 UNIT = 1/2000 VIDI FIELD 


Figure 3- 4 
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a function of the spatial location of the scan along the set of 
triangles. Since the width of the triangle at a particular scan 
is a linear function of the position of the scan along the 
triangle, the plot just mentioned may be considered to be a 
function of the width pf the line being scanned. Hence the 
x - axis Ln the plot is lii units commensurate with this distance 
measure, and in the same scale as is used in Figures 3. 2 
and 3. 3 relative to the physical dimensions of the vidissector. 
The values plotted are thus those of kLn'f 1 /mfx)) - kLn(l/c), 
where m(x) is the actual minimum (since the target is dark) 
of intensity along a scan of a line of width x, and is the 


background intensity. If the blurring function behaves 
according to the theory proposed* we should have; 


c 


J2 


xl 2 


m (x } = d 
-xf2 


l J gUOdu = 2d J *(u)du 


(3. 25 


w^here d is the absolute value of the intensity difference between 
the background and the target. Using the curve of the integral 
of the function in Figure 3. 3* and doing a certain amount of 
arithmetic involving logarithms* we can obtain a curve of 
predicted maxima in accordance with the premia expressed! 
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In (3. 2), and with the assertion that the curvat tn Figure 3, 3 


represent g(x) and its integral. This curve is indicated in 
Figure 3. 4 as the dashed line superimposed on the plotted 
curve in the figure at the right. The closeness of these two 
curves indicates good consistency between these two approaches 
to finding g(x); and provides further evidence that the curves in 
Figure 3, 3 represent g{x) and its integral. 

A third approach to the computation of g(x) is based on 
the fact that at a wide edge, the value of the intensity along a 
line normal to the edge is related in a simple way to the 
function; 


y 



_ nfl 


In particular, if the intensity function for a vertical edge is 
given hy; 

I{x) ^ a x < 0 
I(x) * b x > 0, 

then the distorted value of intensity, is given by; 



This equality is derived by an argument similar to that given, 
abcjve„ in Figure 3, 5 we have the values of lsLn{l / intensity) 

* POINTS OBTAINED FRflM THE 
INTEGRAL CURA 



-SCAN 

LINE 


SOURCE 

OBJECT 


INTENSITY PROFILE AT AN EDGE 
1 UNIT - 1/2000 VIDI FIELD WIDTH 


Figure 3, & 


for the intensities along a line normal to an edge, subject to 
the blurring of the vidis sector. The illustrated points along 
the curve represent values obtained from the integral curve 
in Figure 3.3, Suitably Scaled. Fur clarity, the curve 
represented by these points has been omitted. The close 
Correspondence between the points and the curve further 
verifies that the curves of Figure 3.3 are a good approximation 
to g(x) and its integral, 

HI. NOISE AND THE COMPUTATION OF PtJ^i ) 

A given noise-free sample turns into a distorted 
sample I# as shown in the previous section by the convolution 
of I i with some blurring function. The conditional probability 
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may easily be expressed as the probability that simple 
noise on the sample would give rise to the configuration of 

intensities J-. 

4 

It has been claimed that a large number of intensities 
read at a given point, under a given lighting situation by the 
vidissector have approximately a normal distribution. 
According lo the way in which the vidissector is constructed, 
the absolute noise level is a constant for the logarithmically 
scaled intensities delivered. Actually there are four possible 
noise levels; however all work in the remainder of this paper 
will involve only one, the most accurate. Hence we shall 
assume that there is a single constant noise level. The 
intensities read at a particular point for a particular set of 
lighting conditions follow the distribution; 



where a is a constant. From this may bo computed the 
probability of a given configuration of intensities 


Vj. v , ... , at points with actual intensities 


Up u^, ... u^. Since the noise-induced deviations are 
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statistically independent, this probability is- 


in _ 1 f u ' ~V| V 

n l /j IL a J 

d Vl dv 2+ .. dv m , 

i=l 


or, letting 



= E («k" v 

k 



(3.31 


with ; 


J j " *' b V v 2* 
we have: 

.itel 

fWj'Ii) ■ HTjUf) - (^=7- i? dv l dv 2- .. <lv m . (3. 4t 
The value of a for the signal to noise ratio has been reported 


(Horn 196-9) in terms of the percentage error of a logarithmic 


intcnsiLy value corresponding to an error of one standard 
deviation of the errors at that intensity. Again, this 


percentage is a constant for all intensities, and is reported to 
have the value 1. 6fc. Since the logarithmic intensities are 
given hy: 

iOQ^og^l/Dp 

the ahsoiute error corresponding to One Standard deviation 
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a. s) 


•a > 64, Log^I - -016I) - 64. Log^I) = 1. & 

This is the value of a which will be used in (3, 4), 

The procedure far computing the conditional prub ability 
Pt J (Sis to determine the blurred version 1£(S) of the 
set of intensities and to calculate the value of 

P{ Jj(S)/(S)} by (3, 4). The relationship between and 
1^(SJ is in general governed by the function f(Uj v) referred to 
in the previous section. However we shall consider only 
cases where <3, 1) applies., and will need only the function 
g(x} to determine this relationship, 

IV. A MODEL FOR THE SET |l*} AND COMPUTATIONAL 

consequences ’ 1 

In this section we shall give models for the sets 
of noise-free distorted intensity configurations taken 
over particular rectangular regions S. Our attention will be 
confined to sampling regions S which have a particular- width, 
and whose lengths are integral multiples n of the width. We 
may consider Such a region to be composed of a Square 
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sub-components, denote it by and use the definition: 

I*(S ) = I#! 1 , 
in i 

Kules will be given lor assigning a priori probability values 

Pa*'/) to the elements of r It ■will be recalled that there 

is a determinate 1:1 correspondence between elements 

and elements 1+ Thus the analysis in section I of this 

chapter remains valid with E*T in place of L(S). It follows that 

1 1 

the value of Q(JfS)3 of (2.1) is determined by (3, 4) and by the 
values of P(I*”). The latter are the subject of this section, 

Consider, for a fixed n, the set \ I*^j of all noise-free 
distorted samples over rectangular regions composed of n 
square sub-components. We shall divide this set into four 
subsets as follows; 

L.el CL. be the subset of consisting of sets of 

1 l f 

intensities from lines in the visual field exactly 
centered in the rectangular region. 

Lot CE be the subset of | I*| | consisting of sets of 
Intensities from edges in the visual field exactly 
centered in the rectangular region. 

Let CH he the subset of fl** 3 j consisting of sets of 
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intensities from a homogeneous area in the rectangular 
region. 

Lei CS he the subset of jl* n l consisting of sets of 

i 7 

intensities from lines or edges which are not centered 
in the rectangular region. 

Wc shall first consider a model of CL, and base it on 
the following assumptions; 

1) That the absolute intensities of the samples of CL 
are of no con&equeuee* so that in each square 

sub-component of a sample 1*^ the sum of ibe intensities 
may be assumed to be 0, 

2 ) That on any section across some j-th sub-component 
of a member I*? of CL* the intensity function has the 
foi-m; 


a i, j« (x> * b i, j 

where aj ( will be termed the relative amplitude , surd 


b is chosen to conform with assumption 1). 

L J 

5) That the relative amplitude a^ ^ of an intensity peak 


4or valley) is uniform within the j-th Sub-component of 
I+!\ A sample I*? may thus he described in terms of 




an n-tuple of relative anipliludts (el. p P + ) a e. g. 

1 Ij 

35 I*(.a . . ♦ , H. h 

l 3 i lj n 

4} Thai each sample- ‘was given rise to from some 
line* highlight, etc,, in the read, world with an 
"idealised" relative peak (or valley) amplitude a^ 
which i a uniform along the length of the line. 


5) That this Idealized relative amplitude is purturbed 
randomly along the length of the Line so that there is a 


minor fluctuation of relative amplitude a^ j among the 
various sub -components u£ a sample with a 
normal distribution with, variance 

The first of these assumptions ignores a certain amount 


of information about a line which is useful in distinguishing it 
from a non-line. Broadly speaking., it prevents a distinction 
between a series of peaks in aline whose absolute intensity is 
con at ant or regularly varying; and a series of peaks in aline 
whose absolute intensities vary randomly or d is continuously. 
This is nut undesirable in the case of a line lying in the real 
world partly In shadow. However* it would be desirable to 
eliminate ua lines a aeries of "lined up ' intensity peaks whose 


absolute intensity varied randomly, as this would likely be due 


to noise. 


The second assumption is justified on the basis of the 
discussion in the first section, and by the fact that we are 
considering noise-free but distorted samples. 

The third assumption is justified on the basis that the 
"ridges" of intensity of sampler in CL are rather uniform 
along their whole lengths, and would thus be quite uniform on 
square sub-components. This assumption is particularly valid 
if a square sub-component is only sampled along a line 
traversing it perpendicular to the orientation of the rectangle. 
This is approximately what is done in the program which will 
be discussed in the next chapter. 

The "idealized' 1 constant relative amplitude of 
assumption 4} may be thought of as the relative amplitude 
which would be obtained in the absence of physical defects of 
the abject being viewed or on the vidissector photocathode, and 
in the absence of spurious local reflections and. anomalies of 
lighting. The purturbations of assumption 5) may be thought 
of as a result of these defects etc,, e. g, a nick on the edge of 
a cube, a slight shadow or a bad spot on the photocathode of 
the vidis sector. The idea of an idealized constant value of 
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the relative amplitude along an edge is further justified by the 
fact that intensities used will be logarithmic. Any ridge of 
intensity, for example a highlight., is a relative contrast 
phenomenon, and may vary in absolute intensity, but not in 
relative intensity. A logarithmic intensity function would tend 
to register amplitude of highlight the same regardless of the 
absolute intensity. The same is true when the argument is 
applied to intensity discontinuities at an edge. 

It follows from these assumptions that if we let Ffa) 
be the a priori probability of an edge in the real world with 
'’idealized" intensity a,, then the probability of existence of 
a particular I*? = I*(a. L , ... , a^ n ) given rise to by an edge 
with idealised relative amplitude _a and parameterized by 
amplitudes bl n is given by.: 



any idealised amplitude is given by the Sum over a of' the above 



This sum may then be evaluated provided the distribution 
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F(a) is known. Assuming it is normal with standard 

deviation p , we have: 
n 


F(aj 


= P{CL) 


e 


1 

2 



where P(CL) is the a priori probability of existence of 
a member of CL. We then have: 


.... a^)) 


P(CL) 0 


-jbrm 


da da 


i,l 


da i.n< 3 - & > 


This sum, including the differential da may be expressed as 
ajs integral, with the exponent slightly rewritten: 



□D 


The exponent may he further rewritten as: 



Letting: 


A = 
B = 


1 n 
^ a “t 

>?3 " 


* 


and com plotting t he square, the exponent becomes, in 
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terms of A arid B: 


i \aU 2 -2MB1A) + (B/A) 1 -) - B*/A + 


Tina integral becomes’ 



-A/2{a - B/A) ! - l/2(5a s /*£- E 2 /A) 

T da.. 


The second term in the exponent is independent of the 
integration variable a, and may be taken outside the 
integral sign. The remainimg definite integral is well 
known to- have the value \W A. Thus the Integral is 

equivalent to: 



f A 

The result of substituting in this expression the values 

of A and E, of substituting the resulting expression into 

(3. 6), and of doing some straightforward algebraic main pul at ion 

is: 


P(l*(a- 

Js ^ *■ 



Pi CL) a* 


i2 V5g+ 










An analysis of the CE category may be made in a nearly 
identical fashion. In this case* the function g(x} of assumption 2) 
is replaced with the function h(*), its integral. As was pointed 
out in Section II, tMa function gives the intensity along a normal 
to an edge., and Is the obvious correspond to gtx),, which gives 
the intensity along a normal to a lire. A formula for the 
a priori probability of a member of class CL, may be derived 
from an analysis nearly identical t.o that given above. The 
rasultlng formula differs from (3, 7) only in that different values 
appear for the variances a n and p n > and that P(CE) is used in 
place of P(.CLJ, 

Again, an analysis of the Cil category may be made along 
nearly identical lines. In this case, the function g(x! is replaced 
with l(x) = ax - h, the function which gives Use intensity profile 
across a homogeneous region. Again the resulting formula for 
a priori probabilities of members of CH differs from £3, 7) only 
in the values of a„ and and in the use of PtCIIJ in place of 
F(CL). 

At this point it is Convenient to recapitulate Some of the 
foregoing by rewriting the formula for Q(J(S)) appearing at the 
end of Section l in terms of the specific notation introduced in 
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later sections, and Some additional new notation, First, it will 
he recalled that the notation I*(a_ ,, , ,, * a- } was introduced 

I lj n. 

to refer to noise-free distorted samples over a region consisting 
of n square sub-components* and containing a line centered in 
the region. A value a, . refers to the relative amplitude of the 

■Lp J 

intensity profile of the i-th sample, taken across the j-lh 
sub-component. We may similarly adopt the notation 
I*<b L - , h- to refer to noise-free distorted Samples 
from the class CE. and I*(e^ |* . . ♦ 3 ft ) to refer to samples 
from CHL We shall reserve the notation 1^ to refer only to 
distorted noise “free samples from the class CS, We may 
introduce similar notation for noisy samples by a definition 
similar to that used at the beginning of Section IV: 

By this notation is meant the i-th possible noisy sample on a 
region consisting of n Square sub -com ponents, 

The sets CL, CE, CH and CS provide ub with an 
alternative for expressing the function GtI|t.S3) used hi the 
formula for J($)3 in Section L if we majee the following 
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definitions: 


cUj”) - 

J 


Z PU V 1H \ i- 


■ • \ n ww \l' 


. , )), i3.a> 


CE(J J ) = 
J 


Z p ' J >* lb t r 


b i,n»f» U 


I h ■ + 3 


bi J), (3.9) 


n 


CHtjJ 1 ) * 
i 


Y F(J*Vl*(c, , C. jlPd^c, 1? . 

fi— j l, i. ij n x * - 1 

cs(jf) ■ yp(j‘Vi* n )Ftt*!! 1 ). 

3 T - J i 1 


. , c t n », 0,10) 

0 . 11 ) 


Then it folLows from the 1 tl correspondence of distorted 


noise-free elements., and nun -distorted noise-free elements 
that: 

^PU*/L<5 n >}P<I.tS tt )) * CUJ") + CE(J"), 

GU^S^M 

and 

Y P(jJVl.{S ))F(US_»* CH<j”> + CS(J?). 

- ■* J in L u j j 

G(I.(S n ))=0 

Consequently we may rewrite the formula at the end of Section I 


as: 


Q (Jp - 


CLUp t" CE(J^) 

CMJ n ) + CE(J^) + CH(j"> +"cS(7 n T 

J J J J 


(3.12) 



We may now turn to an analyst; of the class CS. It turns 
out not to ho necessary to make an explicit model as was done 
for the classes CE, CL and CIL To see this, recall 
Formula (3.12) of the previous paragraph* and Formulas 
(3. &) ■ (3, ID* which define its components. An element in 


these latter sums f e„ g. „ 


P(J*Vl*(a, . ♦ * 

J 1> 1 


a ))P(I*(a . 

1 a n l| i 


a. 

ij 



from the sum CL* may be thought of as a measure of 


n 

similarity between and the distorted noise-free sample 
E’K&j- - • • > a i J n^ 1 we ighted by the plausibility of the latter. 
Thus the value of CS* for example, is roughly proportional to 


the plausibility or frequency of occurrence of members of CS* 


.n 


and to the similarTty of to members of CS. 

occurs over a rectangle S n on the visual field 
which is centered on the image of a line, the value of 
CS{J^ J ) is quite Small relative to the other members of the 


denominator of Q(J n h owing to the relative infrequency of 
members of CS as compared with members of CH* and to the 
fact that such a j" is as similar to a pattern of intensities 
from a homogeneous region as it is to a pattern of intensities 
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containing a skewed line. Since the value of CS(J^) is thus 
small, it could be omitted in this caae, or at leant approximated 


with the sum of values of 

CL^(J^) + CE k (J n j 
J J 

k 

over a set Of regions S n which are nearly coincident with 
but are slightly skewed with respect to it. These values may be 
obtained 'for free" for any region 5 by a line-finder which has 


to be able to find lines in all positions in the visual field; Since 

k ji k il 

it would necessarily compute CL (J. ) and CE (J, )■ in the 

3 3 

process of testing the other regions for the presence of lines. 

If is a region in the visual field which did not contain 
a line* a noisy sample J* 1 over 5^ would, by a similar argument, 
have the property that makes a rather small contribution 

to the denominator of and could be similarly approximated. 


or indeed omitted. 


It is only for the case that the region S n contains the 

image of a skew line that the value of CS(.J^) becomes 

significant. However, this effect occurs only for rectangles 

approximately coincident with a rectangle S n centered on a line 

in Lhe visual field. Let be the same as but with 

J J 


'iH 


the value of CS(J^) omitted from the de nominator: 


CL(J?) +■ CE{ J n ) 


QHfp = 


J 


CL(j"} +■ CEU") 4 CH(j") 

J J J 


(3, 


Sl 


It has been empirically checked that } obtains a maximum 

value Locally approximately on the rectangle S D centered on the 

n 

line. This is quite plausible* since the value of Q^(J\ ) should 
be large for rectangles approximately coincident with S n , and 
if it didn't have a maximum on S , it would either he offset 
parallel to 5 n , which is unlikely because of the symmetry of 
the intensity pattern; or there would be aeveraJ, maxima, 

n 

which seems not to happem Hence the omission of CSU^ ) 

n 

from the denominator of QQj ) has the effect of giving 
erroneously high values on regions nearly centered on a true 
line, but not erroneously high values on the maximum value 
region, nameLy a region centered on the line, However, those 
values are not so augmented as to create false maxima for 
regions not quite centered, on the line. 

In summary, the set of noise-free distorted! samples 
is partitioned into four classes CL, CH, CE and CS. Our 
threshold function Q(J^) it expressed, in {3, 12)* in terms of 


12 ) 
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four sums CUJ. )j CH(J n )j CE(J ) arid G5{J 11 ) over thes;e four 
■ j J j 

classes. Explicit models of CL, CH and CE allow a simple 

explicit expression of the a priori probabilities of members 

of these sets. These probabilities, together with the results 

of Sections II and lit, determine the values of the sums 

CLfJ 1 " 1 ), CH(J. ) and CE{,T ), It has been shown that CS(J ) 

J J j j 

may be computed indirectly, or even omitted from the 
denominator of The latter is permissible, resulting in 

Formula (3. 13), in the case where the regional predicate is 
applied systematic ally over the whole field of view. 


COMPUTATION'S OF CL(Jj t GE(J n ) AND CH(J n ) BY 
MEANS OF INTEGRALS J J 


in the previous section, it was pointed out that the 
threshold function Q(J^) could be approximated with the 
function given by (3. 13). This function is determined 

entirely by the values of sums CL(J n ), CE{j") and CH(J n ), as 

I v J 

defined by {3, 8), (3. 9) and (3. 10). In this section, we shall 
show how to express these sums as integrals, and tn reduce 


Lhem to relatively simple closed form. 

It might seem a gnod strategy to evaluate the 
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expression, fur example CL(Jj I os given by C. 3- , -8), by 
substituting value5 given by {-L 4) ami {3, 7} respectively for 
the two terms within the summation sign, expressing the 
resulting - sum as an Integral,, and finding a closed form for 
the value of the integral. This approach appears to run into 
difficultiesj and a slightly different approach, will be used 
instead. 

Our first step is to express, e, g., CL{J*') in a more 
convenient form, Since the sum in {3. El) is taken over all 
n-tuples, CUJ") may be expressed as; 


X I ■■» 


a i, 1 “i, 2 

.. a l, n'> P <I*‘ a i,l . a i,r”. 

a i,:n 

where the sum aver a^ ^ means that a^ ^ in the summand 
lakes on all positive integral values. We may express 

P0*<\ ,. x, „» “ 

^PU*^ j.;v n >/a)P(a}, 


where P(a) is the a priori probability of a line with 
Idealised amplitude a; and PlTMa^ ^ ... , a^ n )/a) is the 


relative probability of occurrence of a noise-free distorted 


sample with sub region amplitudes a 1 j, „. . ^ Qi given 
a line with idealized amplitude a, The conditional probability 
PlPMa^ ^ , . rT . a^ n )M) may be expressed, as in Section IV, 
aa a product of probabilities : 


F(I*(a. 


I 


\ n i/^ 



/a). 


where Pta ijk /a) is understood a& the probability, given a line 

with idealized amplitude a, that the k-th sub-component ol 

a noise-free sample will have a relative amplitude a. , , The 

ij -K- 

above probability may be expressed as a product, since the 
elements in the product are statistically independent. 
Likewise,, bv statistical independence, ^ , ( 

may be expressed as a product; 


1 




k= 1 


where j"(kJ is understood to mean the set of intensities of the 
noisy sample Jy which lie within the k-th square sub-component 
of the region. Substituting and rearranging, we have; 

CL(jJ ] l = 


It is not very difficult to aee that the product over k and the 
summations over the a. ^’s may be interchanged, so that: 
CL(Jp = 


* k=1 \k 

Similar expressions exist for CE(J n ) and CHC J'.'jr 

J J 

An expression for F(J?(kJ/a. > may be obtained by 

i « 

adapting (3. 4} to- the present context, using the value -of a 
from {3, S>; 


(3. 14) 


1 Dip 


FU,[k)/a. .} 




« 2 U.Sfi m 

€ <K v • • (3.15) 


Jit 


where 


m 


D. 


b j. k 


= X< k -v‘j 2 


t=l 


j> k ' 


( 3 , 1 &) 


which is similar to (3^3) in that it refers to some i-th noise- 

free distorted sample and a j-th noisy sample, but. has a 

third subscript to indicate it involves only the k~th 

sub-component , The values u*- ^ are tb« £p intensity values 

within the k-ih sub-component of the i-th noise-free distorted 

sampLe containing a line; and are taken over points which may 
t 

be denoted by Since the amplitude in this- region ia 
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\ k‘ we liave by assumption 2 ) of Section IV that the intensities 
at points p- k are given by: 

u i, k ” a i, k^i, + ^i, k> 

where x\ f k is the perpendicular distance between p} ^ and a 
line traversing the center of the region in the direction of the 
expected line. If the geometry of the points pj . is fixed for 
all samples and Sub-regions, then the value of g<x* k ) is 
independent of the sample and sub region, and we may 
express such an intensity value by gfjtH. By assumption 1) 
of Section IV, we rosy choose b i k so that the sum of u£ k is 
zero, i. e. , by choosing b. ( ^ - f, Hence defining values 
(U 1 , ♦ , U JCl ) by: 

u l = g(x l ) - £ gteS/m, <3, iyj 

t 

we may express the m intensities in the k-th sub-component 
of the i-th distorted noise-free sample by: 

m i 

tUf k J - - - , Uj = 

(a i, k u '* ■-■ * a i,kU 111 ) (3. 18) 

where: 

ljt = {3.19) 




To be eon £ i£tont with assumption l), we should also assume 


that: 


? 


h k 


(3. 20} 


The valuo of D. , of (3. 15) may be expressed in terms ol the 

lp ]j K 

values jusl defined, as: 


D 


t,2 


i,j> = ' a i,k U > 


(3+ 21) 


It is easy to show that: 


D 


where: 


Uk’^k-ak 1 


?uV k 

&#■ = -- 

b - V (uS 2 

I 

t t 2 

R ^~Y\ iv. - a^ U ) f 

Y j, k h* 


(3,22) 


(3.23} 


(3,24) 


(3. 25} 


Combining we have, omitting the differentials dv^ k : 

_ I j~ b(a 1K - a'; L ) 3 ■» R it , 1 

PlJ^kl/a. k } --*—— Q (1f5} 3 J. ( 3 . 

We may express P'{a^ k /a} as before by assuming a 
normal distribution on the various values of k , with 


25 ) 
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standard deviation $ and mean a: 

n — 


H \k' a > = 


1 


a - a. 


Y2 n Q r 


d \ k- 


(3.2 7) 


Combining (3,14) X (3, 26) and (3< 27) we have, again omitting 

differentials dv* , ; 

h k 


cuj“) = x . 7 -— 1 _ 

a M t: k 


b(&,k - ) r + R. t u-a lh ) 5 

■-+ “ 


(i. sr 




da^da (3.3S) 


with b, a^ k and k given by (3. 23), (3. 24) and (3, 25). The 
inner sum may be put in the form: 

„ -Ba; + Ca. 4 D 

A Z f da 

a i > k 

whinb admits of the approximation used in the preceding 
section; 

“■Ex^ tC*+D 

a X € d5C ^ 


A 


m a 

J ^ ’Bj: + Cx + 


c* 


D — -+ D 

_ A\ ljr Zi 4B 

ye" 


di = 


Applying this approximation to the inner sum in (3. 23), we 













have after considerable alga-hra; 


CL(J 


sryu> 5F + b 

.1 [R*_ 1 

£ 2 [(1 5) s Cl. sy + brt J da 


where again , the diffentisls dv have been omitted* 

]*k 

may alternatively be expressed: 


This 


CL(jJ*} — ^F{a) 


1,5 
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and expressing P(a} aa before by; 
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this latter expression for CM ) may be put in the 
form: 
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and may be approximated as before to yield: 
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Etfl-B)* (1. SP+bp^+nb^ (boif+O. &S 2 MbpJ + nbpy-Kl, 5)* 

,(3.23) 


with differentials dv. omitted. Similar expressions exist 

Jj It 

for CE(J* J ) and CH(J^). 

J J 

VI. APPLICATION OF THE THEOHY TO SOME ACTUAL 
VIDISSECTOR OUTPUT 


Ira this Section we shall apply some computational 
procedures suggested by the foregoing theory to intensity 
values obtained from the vidissector. These intensity values 
will he taken along single lines normal to various lines and 
edges In the visual field. The results of the computation 
will serve to validate the theory presented, and justify 
some as sumptions and approximations in its computational 
implementation which will be used by the program described 
in the next chapter. 

In applying the foregoing theory of a regional line 
predicate, it is first necessary to choose a suit ah le physical 
width for a rectangular region. It appears that., for the 













vidissector in current use, this width should be between 25 
and 50 milts, where one unit is 1/2000 of the full field width. 
This range of values te chosen to conform with the assertion 
that, in the terminology of chapter two, the majority of 
regional evidence for the existence of a line is uuntained 
within a neighborhood of the line whose radius is on the 
order of a few times the "critical resolution radius" of the 
vidissector. This latter quantity, as defined in Section I 
of chapter two, may be easily obtained by examining 
Figure 3. 3* It may be seen that the intensity in the upper 
curve falls to one half of its maximum value at a radius of 
three units from the center qf the curve. This value Is 
approximately the critical resolution radius sa previously 
defined. For present purposes. We took H a few times" to 
mean specifically eight times, which yielded a region width 
of 50 unite. Later results, reported in the next chapter, 
indicated that this value may have been conservatively large, 
and somewhat better results seem to have been obtained with 
a region width of 2$ units. In any case, the value of 50 units 
turned out to be adequate for present purposes. 




It seems appropriate to begin an empirical investigation 

of the properties of the regional line predicate here developed 

with a consideration of the case where the region to which it 

is applied consists of a single square sub-region. This 

admits of a simplification in the formula for Q^uJ 1 ) as given 

by (3. 131 and {3. 29). In particular, the term involving 

(a* , - a* | in (3, 29) becomes zero, since a* is the 
i' k J*k h k 

average of only one term, Thus this term is eliminated from 
the exponent in {3- 2ft); and likewise similar terms are 
eliminated from corresponding expressions for CE(J Ji ) and 

ch(j“K 

Another simplification of the exponent in the expression 

for CL.(j n ) given by <3. 29), and likewise for corresponding 
J 

expressions for CE{J cl ) and CH(J n ) t follows from a 

J J 

o ons id erst ion of the relative magnitudes of the values 
2 2 

{1,3) and The latter is the value of b given by (3. 24) 

times the variance of values of idealised relative amplitude 
of the various lines in scenes in the real world. Since the 
distribution of these values has a mean of zero. It follows 
from elementary properties of the normal curve that about 
1/3 of all lines have idealised relative amplitude a with the 
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property that (at > o-^- Since the variance of the sub-region 
amplitudes a. . is small relative to the variance of the values 

ij F J 

of a* the same holds true of these amplitudes, 1, e, , about 1/3 

of all mb -components of noise-free samples containing Lines 

have amplitudes a, , with la, . I > c , [f the intensities 

j j n 

within a sub-region of a noise-free distorted sample are given 
by (u^ ... a up 1 ^) and their spread is defined a&t 



with 



then It is easy to see from (3. IS) that this spread has the 
value jn/b s where b is as defined in {3. 24), It follows 
from what was said previously that about 1/3 of all sub¬ 
components of noise-free samples have a spread of greater 


than yfb 



& r 

n 


Large value of the spread of intensities in sub-components of 
noise-free samples containing lines. In the case of noisy 
samples containing lines, empirical investigations suggest 
that a spread of 3U is not uncommon; and it is easy to See 
from the fact that noise level is relatively much smaller than 
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30, that this value Is also not an uncommonly large value of 
spread fur noise- free samples containing lines. Consequently; 

b^» (1.5) 2 , (3.30) 

Now by simple algebra the exponent in (3. £0) may be written. 


excluding the third term which is aero, and using the relations 
in (3, 23), (3, 24) and (3. 25); 

+ n,,;) 


0.5)* (1. sftd, sT+b^+nbpf) 

It follows from <.3, 3 5) that the coefficient of the second sum 
may be approximated by (1/bU- 5) a ), so that the exponent of 
{3, 29) Is almost exactly equal lo; 


£< T i.i> _ ‘? utv 5.i>' 

0.5} ” b(l. 5) 


(3,31) 


A similar sort of simplification of the coefficient of e 

in {3. 2 9} may be made from a consideration of the relative 

2 2 2 

tnaPiiitudOE of ribp and b? a Tht? vdilu^ t>f & Fftpris scuts tht 
° jti n *■* 

variance of a quantity a, idealized relaLive intensity; and 

p is t according to assumption 5) of Section IV, the variance 
n 

of small pur tur bat Iona of the latter. It is reasonable to assume 

2 2 2 2 

that GT » p , and that even bv » obp . By this approximation 
n n n n 


02 










it follows that the coefficient in (3, £&) is close to: 

pi CD 


(3.32 > 


Vbo„{ y^l. 5)' 

If this and the approximation in (3. 21) are applied to (3, 3£J), and 

similar approximations are applied to corresponding formulas. 

for CE(jj) and Formula (3. 13) reduces to: 

. 1 . 




PI CD 




L SM,j ) 

^iI. ::■ > 7 , PIC.;- 
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mu 


1 SEP 
2(1. 5 ) J 


(3. 33) 


I SUl) I SK(j) 1 SH(] ) 

PtCL> „ 2 (1. 5F. P(CE) n 2 (1. 5P , P( CH) r ,2 (1. 5) J 

t t VTj"o^ c 

Where: and are respectively the idealised relative 

amplitude variances ol elements of CL f CE and CH; 

b =£(uh 2 * (3.34) 

1 1 

and (II , U ) is some paradigm intensity 

pattern for component regions of members of CL: 
b'^StU 1 *)^ (3.35) 

t 

and (TJ 1 , . n , t U 1 ™) is some paradigm intensity 

profile for component regions of members of CE; 

*>" =E<U Mt > a , (3.36) 

t 

and (U" , . r. , U ,,m ) Is some paradigm intensity 


profile for component regions of members of CH; 











(3. 37) 


SL(j) - j) a /b 

SE(j) = j) 2 /b 1 

SH<j) ■ (£ U Mt v^ 1 ) 2 /b r ' 

I rti . , . 1 

and {v. j .. , * v. J are the intensities in Jj. 
j* 1 Jn 1 J 

It is necessary to assign values tu the remaining 
constants in {3. 33). First we shall assume that, lines and 
edgeS are equally likely, SO that P(CL) = P(CE). A1&0 in 
the examples which follow, it will become clear that an edge 
or line occurs in one sample out of 75 h so that; 

m&r(CH) = P(CE) ■ P(CH). 

Secondly t it follows from empirical investigation of the 
range of spread of homogeneous samples with, various 
gradients* that five is a reasonable value for b"o^ . It was 
already pointed out that 30 is a reasonable value for bt?j, 
and we shall assume this is the case for b r tr'^ as well. Thus 

q*(jS 

5L(j) 5E(j) 

2(1.5)* 3(1,5-) 1 

e - e 

SL(,i) 5E(1) SH(,i) 

3(1.5)* 2(1. 5) z 2(1.5)* 

g 4- 450 g 


(3. 3B> 
(3. 39) 


(3. 40) 
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For values greater than ,5 this function is nearly 


m onfctOne with: 

Mbx(£M])/ 2(1 + 5> 2 , SE(j)/2U. 5) 2 > - 
SH(j)/2U, S) 2 - L,n(450.), 

or equivalently* with the function given by: 

= 

i 

MaxtSUjhSE(i)) - SH(j> - 2 7, 5 (3. 


This follows from an observation about the results given later 
in this section* namely that SL(j) and SK(j} are rarely of the 
same order of magnitude. This is not surprising, in view 


of the fact that one expresses the similarity of the obtained 

pattern to a noiae free edge* and the other expresses the 

similarity to a noise-free Line. For vslues ofQ*(jh 

d 

greater than . 5, the pattern must be at least somewhat 

similar to either an edge or a line. It could not be 

Simultaneously similar to both. Consequently the formula 

<3. 40) above^ which is of the form 

A 4- B 
A+ B + C 


has the property that when its value is above . 5, A Mid B 
arc considerably different in value, and both positive. 



It is not difficult to show r that in such a case if f for example 

Mas (A, B) > 10 Min(A, B}j. 

then the approximation: 

7vlajc(A, B} A + B 
Max(A, B) + C A +■ B + G 

is good to better than 6 percent. The fact that is 

3 

monotone with Q**<jp follows from the fact that 
_ _ Max(e a , e 1,J } 

77 , a tT c 

Msx(e , e > + e 

is monotone with Maac(*, b) - c, if a, b and c are positive. 

It is desirable to apply the predicate to a variety of 
regions which are homogeneous, contain off-center lines, or 
contain centered lines or edges. We have chosen data from a 
series of areas on the visual field which are 200 units wide 
and contain the images of vertical edges and lines approximately 
centered laterally. The predicate will be applied tn 75 
successive overlapping regions 50 units wide, which are 
offset relative to each other by two units and thus exactly 
cover the 200-unit-wide area. Tiie procedure will be applied 
to vertically oriented regions only, since only vertically 
oriented lines exist in the data samples. The fact that 75 
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regions are tested and only one contains a centered line or 
edge justifies the relation P(CH) = ?5P{CS0 used above. 

Finally,, before applying ibe predicate to real date, 
which will be done by computing the function Q#*{J ■),, it is 
necessary to give values for the sets Ju^l* |u'^j and JU 1 *J 
used in formulas {3. 341 “ (3- 39). It will be recalled that 
these are paradigm sets of intensity values at points in some 
fixed geometry within a square sub-region. They correspond 
respectively to a line centered in the region* an edge centered 
in the region* and a homogeneous region. According to the 
fixed geometry which we shall use* the points will be equally 
spaced along a line traversing the square sub-component 
through its center and oriented normal to the expected line. 
These values may be ordered in an obvious manner according 
to their positions along the line mentioned. They era shown 
graphed as & function of this ordering in Figure 3.6, The 
values of b* b 1 and b" for these sets of intensities are all unity. 
The intensities from the real world will come from single scans 
of LOO points talien normal to a vertical sdgE or line in the 
real world. The points will be separated laterally by two 
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units, so that the total width (if the area scanned will be 'l 00 
unite, If II desired to apply to some region along 

J 

this seen, out of the 10u intensities l L , ,., . f some 
set I i+lJ . .. , I i+2S fall within the region. Then it is 
trivial to select intensities from among these to he used as 

1 Tl 

the values v ** ... M v , for use in formulas (3. 37). 

jj a. jj i T * 

(3. 38) and (3, 39). They are simply I . . . I respectively. 
Thus we will he applying (3.41) to 75 successive 25-tuple? from 
the 100 intensities in a particular scan. 

It is important to digress here to point nut the 
advantage b of the sort of geometry of points within a sub-region 
which is used above. This advantage will be realized in the 
next chapter when it Is desired to apply the regional predicate 
exhaustively over the whole field. In particular it wilt be 
desired to compute the predicate far lines of all orientations 
through any point P on the visual field. Consider those 
situations where the regions are oriented within +45 degrees 
of the vertical axis of the vidissector, and all pass through 
some point P; and consider only the square sub-region 
containing the point F* which will be termed the p-tb 
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sub-region. We shall in chapter IV take intensities relevant 
to regions so oriented, along lines separated by approximately 
the width ,s of a region, and oriented parallel to the st-axia of 
the vidiElector, We may thus assume that there will be a 


unique scan passing within s/£ of the point P; and that the 

intensities ... , l ffi along its length within a distance s/3 

of F are exactly the ones from which the v^ will be selected. 

i* P 

The procedure for selecting the values v\ from among this 
set is parameterized by the angle 0 which the region makes 
with the vertical. If the spacing of points in the fixed 
geometry of points is d, then one wishes to clioose points from 
among the 1^, ... , I m such that their actual spacing is 
approximately d/Cos^). If the spacing of the points along the 
scan line is itself d, which will usually be the esse In practice, 
then this matching of obtained intensities with those in the 


prototype amounts to ''stretching"' the former by some factnr 
between l and ^2. Thus the various vaLues of, e. g, , 

£E(jf } ~ Lr v. u\ which are used in the computation of 
Q^u") for various regions containing P, differ only in the 
amount of "stretching" of one spatial ajtia relative to the 
other in the matching of intensity values of the scan against 
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those of the set \ u* J- Denoting these various values of 
i} n 

CE(Jj by CE(Jj 0), if turns out empirically that the range 

of these values i& rather small; and in particular for | 0 | < 45°, 

tiie values are within smoothing like 2 0 percent of the closer of 

CEfJ 11 f 10 a ),CE(j n j, 30 a ), One may thus compute these two 

r J, p 

values only, and for any region containing the intensities from 
which they were computed, use one or the other in the 
calculation of for that region. In fact we shall in 

chapter IV actually compile these two values by Stretching the 
spatial dimension of the paradigm, rather than vice versa. 

This amounts to using two peaks of different widths paradigm 
profiles for lines., and two edges of different severity of slops 
for paradigms for edges. It should be clear that if the fixed 
geometry of the points were two-dimensional, e. g, on a 
square grid* no such, simple accommodation for the various 
angles might be possible; and doubtless the amount nf 
computation involving the intensities in each neighborhood 
would be far more than the calculation of two values. 

To return to the application of Q** to real data, cur 
first example. In the upper left of Figure 3. 7, comes from 
a horizontal scan across the forward edge of a cube. The 
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scan covers approximately one eighth of the apparent width of 
the cube. The cube is a solid metal block which has been 
painted with white paint so as to have a very uniform surface 
and sharp edge. In each of the eight figures, the logarithms of the 
reciprocals of intensity are given as the bottom of the two curves. 
The absolute range of values is 11 units, where $4 unite corresponds 
to a factor of two in intensity. It is easy to idler from the physical 
properties mentioned that the slope of the intensity curve on either 
side of the edge is due to a systematic non-uniformity in illumination 
rather than to a non-uniformity of reflectance properties. At the 
edge itself there appears to be a sort of "negative highlight 1 '(a 
local peak). This appears also at the centers of the scans in the 
upper right and upper-middle left examples of Figure 3.7„ which 
were taken from the same cube; and is apparently a property of 
this particular edge. The 100 intensities in the example give rise 
to 75 values of Q** which are graphed above the intensity curve, A 
value of Q*? is derived from 2b successive intensities consisting of 
the one just below it and twelve on either side. Thus a peak in the 
value of Q** should exactly coincide with a peak or discontinuity 
in the intensity profile. The horizontal lines in each of the 
eight figures are placed at distances along the Q** axis which 


correspond to values of which are indicated on the lines, 

A reasonable threshold value for Q* appears from an 

analysis of this ex ample, and those appearing later in tills 

section, to be about 0. 1, A cutoff level of approximately this 

magnitude will be used by the program described in the next 

chapter. This cutoff value is chosen on the basis of its giving 

about J jo% false positives. There is no simple exact relationship 

between the Q* cutoff and the falae positive error rate; however 

it follows from the first theorem of chapter two that if is the 

cutoff value for Q*> then l-|g i s an upper bound of the false 

positive error rale. This may he seen by noting that for the 

tlireshold procedure, the sum in E2, 3) gives the false positive 

error rate, Every element in the sum is some probability 

P(J. ES)) times a value lefiS than 1 -j3. Since the values O-f 
3 

P(J{5)) sum to one, the sum in {3- 3h L e. , the false positive 
error rale, is less than i-£. Thus thresholding Q# at 0,1 should 
give a falsa positive error rate less than 0.9. However, the 
extent to which the false positive error rate ia actually less than 
0. 9 is an empirical matter, Evidently the various probabilities 
and bo forth are such as to give an actual value of 0, 7 in this 
case. 
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Am abvious question now arises; hpw subtle may an 


edge or line be relative to the noise level in order to be just 
detectable^ e. g. . with the threshold of 0. l* An example of 
such am edge is given in Figure 3. 7 at the upper right- It in 
possible to make a general quantitative description of such a 
Line or edge by means of a value derived from the cutoff value of 
Q## r Suppose the cutoff value is 0*1; then we haver 


Max 

SL(i) 

e m ’ iy 

SE(j) 1 
^2U-5 f 
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2(1. of 

_ 2(1. b) 2 
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2(1. 5} 1 
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450. f? 


SHt3> 

2 ( 1 . 


Max(SL(jV2(l* 5)1 + i*n(9J - 

SH(j^2(l* 5) r + LN(4S0. 


or; 


Max(SL(j), SE(j)J - SH(j> -27*5 =* 2(1. 5f L,n(9> ^0.9 


or; 


Max(SL(j), SE(j)) - 5E(j) - 17* G 


(3.42) 













Since SL(j) p SE(j> and SH(j) are positive, the minimum value 

of [Vlax(SMj.)p S-E(j)) subject tO (3, 42) occurs when SHtj) - 0. 

This is the case when the net intensity gradient for the samp]? 

it zero; a feet which can he deduced from (3, 3&) and a 

knowledge of a nine of the arithmetic involved with simple 

least-squares analysis, [n this case for a marginally 

detectable line or edge, SL(j) or SE(j J ha£ the value 17. 6. 

If the intensity profile follows the form, e. g., of the upper 

curve in Figure 3. 5; then it. is not difficult to see, by the use 

of (3. 37), what its actual peak to valley range would be: 

Suppose the 25 intensities in the noisy intensity profile are 

1 25 

given exactly by all , ,, + ,, aU , Tiien SL(j) for tbeee 
values is, according to (3, 37); 

[ a £ iu ‘) a ] 2 

£ (u 1 ^ 

Flow ever, the denominator term, which is simply b as defined 

t 

in (3. 34), was chosen to be unity for the act of U 's in 
Figure 3. 6; so the value of SL(j) turns out to he simply a 2 . 
This, it was agreed, is 17. Gj so the value of a is 4. 2. 

Thus a marginally detectable intensity profile of this shape 


1 06 



is similar to that at the top of Figure 3, B, but multiplied by a 
tactor of 4. 2; and thus has a peak to valley range of about 
three units. In the case that EEtj) is a maximum and the 
phenomenon, is edge-like, one may assume the approximate 
shape of the intensity profile is that given by the middle curve 
of Figure 3. 6. By a similar argument, ihe marginally 
detectable sample of this sort has a range, in this case net 
intensity difference, of about 1. 7 units. The central feature 
of the Bean in the upper right of Figure 3, 7 has a value of 
Q# at threshold; and the amplitude of the peak at the center 
may be compared with the former of the two theoretical 
values just referred to. The intensity range for the whole 
scan is 17 units, from which it is easy to see that the peak to 
valley height of' the small peak in the center is about four units 
This compares well with the theoretical value of three units. 

Clearly the amplitudes of marginally detectable lines 
and, edges must be considered in relation tutbe noise level. 
Noise may in general be due both to time noise, random 
fluctuations in intensity measured at a point under constant, 
illumination; and to space noise, which consists in random 
fluctuations in intensity as one scans across a surface, h 


combination of the two may be obtained from an analysis of 
successive differences in intensity of the above samples in 
areas away from the known features. This analysis yields a 
standard error of successive differences of about two in all 
cases. Since the variance of successive differences is twice 
the variance of individual values ah cut a mean, then the 
standard error of the latter should be about 2hj2, or about 
l 5 , This is approximately the value of the standard error 
involving time noise only, as reported in (3. 5). Consequently, 
tbe space noise is in this case negligible, which is not 
surprising in view of the deliberate choice of smooth-surfaced 
objects, in any ease, the marginally detectable amplitudes 
Of 3 units and 1 . 7 units for lines and edges respectively 
should be thought of in relation to an underlying note* level 
whose standar d error is l- 5. For example, using the 2 5 
point geometry previously described, one may state -ha. a 
marginally detectable peak has a peak to valley range of 
twice the noise level, and a marginally detectable edge has a 
net Intensity difference of about 1 , 2 times the noise level. 

Six additional example a are given in Figure 3. 7. 

The left-hand upper-middle scan waa taken from the same 


cube and under the same lighting conditions as the top two in 
the illustration. The other five were obtained from a scan 
across the vertical, forward edge of a second cube under 
various lighting conditions. The lower^middle pair., marked 
N EDGES A and hi EDGE 3 A, were taken under identical lighting 
conditions* hut at different heights along the vertical edge 
This cube is uniformly painted* but the edges are slightly 
rounded, accounting for the pronounced highlight (dip in 
intensity* si nee the values are actually Log( l/intensity)) 
apparent in some of the profiles, particularly the nne marked 
NEDGE2A. 

There is a certain weakness in the use of so great a 
region width as 50 units* namely that the intensity profiles 
across a region may have non-negligible gradients toward 
the edges of the region, appearing* e. g, , like the profiles 
in Figure 3. ■&, For this reason, it is useful to generalize 
the thresholding procedure so far described by computing 
values SLjtj), , , . * SL ft (j), SEj(j), ... t SE m (j) for a set 
of n peaked profiles and m edge profiles, and using a 
maximum of all these values in place of the maximum over 
two elements as in 3,41. lienoting this generalised version 


of Q* 1 * by Q 1 **, we may express it in twu slightly different 
f pirns; 

= 

Max (SL 4 {jl,SE. (j)> - SHtj> ~ 2 7, 5 - 
Im k 

Max tSL-(i) - SE(]1,SE, <j> - SE<j» - 2 7, 5. <3, 

l.k 1 k 

This generalised formula will be used in the program described 
In the next chapter. In the remainder of this chapter we will 
discuss its application to the previously analyzed data of 
Figure 3, 7, 

For present purpose e t we shall consider only a possible 
multiplicity of paradigm peak profiles. Four additional 
paradigm profiles besides the one in Figure 3. B are illustrated 
in Figure 3. 3, and denoted by WPEAK, CPEAK, BPEAK, and 
APEAK respectively. It is instructive to compute individually 
the values whose maximum give? the value of Q 1 *+ according 
to the second expression in (3. 43). In particular we shall 
consider six values in the following order: 

corresponding to the paradigm WPEAK; 

SLg(j)-SH[j), corresponding to the paradigm CPEAK; 
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PARADIGM INTENSITY PROFILES 
USED FOR FIGURES 3,9 AND 3.10 


Figure 3.8 
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j>-SH<j), corresponding to the paradigm BPEAK; 

corresponding to the paradigm APEAK; 

SE(,j)-SH(j ), corresponding to th« edge paradigm of 

Figure 3. 6; 

SLj),, corresponding to the peak paradigm of 

5 

Figure 3, 6, 

In Figures 3. & and 3. 10* WC have theS-C Six 'ccmpunenta' 1 of 
Q 1 ** individually graphed above tine corresponding intensity 
profile, in the above order top to bottom, in a manner similar 
to that used in Figure 3, 7. 

One may make a series of observations concerning the 
various curves in Figures 3- 3 and Z- 10, Comparing the 
lowermost two component corves in the upper left of Figure 3. 9, 
it is easy to see that, the pair of peaks in the upper left 
illustration of 3. 7 were due tn the peak "-detector profile 
entirely, This follows from the fact, that the peaks appear 
only in the lower of the pair of curves from 3. 9 just mentioned, 
Regarding the same profile, one may see that the maj,or peak 
from among the component curves is the uppermost. This 
corresponds to the profile WFEAK, which is a wide peak. 
"Evidently the feature represented by the maximum of this 
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curve is the inverted wide peak to the Left nf the center of the 
intensity scan. Another observation concerns the lower right 
example in 3. 9. rt is reassuring to note that although the 
discontinuity present in the intensity profile is quite large, 
it was ''noticed' 1 by none of the peak-detector pro-files. This 
is evidenced by the fact that in the top four component curves, 
and in the bottom one, tne curves are not above threshold in 
the vicinity of the extreme intensity discontinuity. On the 
other hand, the next j to-bottom curve, corresponding to an 
edge, has an ejure me peak at this location. Lastly, one may 
make the general observation that tne maximum of all aix 
component values of Q'** maybe thrcsholded at a considerably 
higher level than Q-*, for example at a value corresponding 
to aQ'f value of . 93, and still detect all edges, b-ut at a 
considerably better signal-noise ratio. Observation of the 
figures shows that at t-his level a few false positives remain, 
e, g, , the peak to the right of the large discontinuity in the 
lower right example in Figure 3. 9. An examination of the 
intensity curve itself would appear to justify the contention 
that there really was "something there" after all, perhaps 
a spot oil the cube, or an insensitive spot on the vidissector 
photo-cathode. 
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CHAPTER 4 

A COMPUTER PROGRAM FOR FINDING LINES 

L INTRODUCTION 



Figure 4. 1 

Figure 4. 1 illustrates- the first stags a in ttie analysis 
of scenes by the program to be described in ibis chapter. On 
the left is a photograph of a set of objects placed before a 
random access optical input device connected to a digital 
computer. Programs jr, the computer have access to 
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intensities in the field nf view at arbitrary locations on s 
2 0000^ by 2O-OOOg grid. Intensities are obtained, by the program 
along 5D vertical-and 50 horizontal scans of 500 intensities each. 
The intensities are converted into "feature points 11 * as 
illustrated in the center illustration of 4.1. feature points are 
locations where the scans are adjudged, by spatially local 
processing, to intersect with ar. edge of an object in the real 
world. Often noise in the real world or within the vidisaector 
will product an intensity configuration along part of a scan 
which is edge-like and gives rise to a "false positive" feature 
point. Thu right-hand portion of Figure 4.1 illustrates the 
output of a program which extracts lines from an array of 
feature points and which is designed to ignore these 
extraneous "false positive'' points by detecting chains of 
lined-up feature points. A final Stage of the analysis, not 
illustrated in Figure 4.1, Is the proposing and verification 
of lines not located by the above procedure. Lines are proposed 
on the basis of Lines already Located, in places whEre figures 
appear to be incomplete. 
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A description of scenes analyzed 
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In thifi chapter we will describe an object recognition 
program based on the theory so far developed.. This section 
will be devoted to a. discussion of the restrictions imposed 
by the theory on the scenes analysed, and on the optical input 
de-vice used* Various scenes conforming to the restrictions 
will be Illustrated* 

Tiie theory developed in the preoceding chapters is 
applicable to certain types of scenes, and to optical input 
devices satisfying certain conditions. Slated informally, the 
restrictions on the scenes are’ 

1.1) The scene consists entirely of relatively homogeneous 
regions bordered by edge lines* 

1.2) The edge lines are all straight* 

1.3) The objects of the scene may be recognized entirely 
from the edge Lines. 

The first of these restrictions is fundamental. It ie 
virtually equivalent to the assumption that an intensity profile 
across a scene consists of a series of smooth curves bounded 
by discontinuities as in Figure 4.2. 


INTENSITY 


hypothetical intensity profile across a 

SCENE IN THE ABSENCE OF BLURRING AND NOISE 

Figure 4, 2 

The See and of' these assumptions is essential if nne is 
applying an edge lest only to narrow rectangular regions, as 
is the case in the program under consideration. Of course 
one could develop a theory , analogous to the foregoing* for 
amalgamating local feature point information over curved bands, 
and thereby detect edge lines of arbitrary shape. However we 
have not done Ibie; it almost certainly would require computation 
of an order of magnitude above that used in the current program. 

The third restriction is a matter of convenience. 

Actually the program may be presented with scenes tlOt 
conforming to this restriction without any impairment of its 
behavior. For example* it might be presented with an edge -an 
view of a cylinder, and successfully recognize the outline. 
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The roundness, though de Lee table by the vidissector from the 
intensity gradient across the surface, would not be delected by 
the present program. 

These restrictions- are summarized in Figure 4,3. 

NOT APPROPRIATE; 



APPROPRIATE; 




ATTENTION WILL RE LIMITED TO A 
CERTAIN CLASS OF SCENES 

Figure 4,3 

The theory requires certain restrictions on the 
instrument which obtains the intensities from the real world. 
These are, in summary: 

2, 1) The extent to which the input device blurs the image 
received met be uniform over the whole field, 

2,2) The extent to which the intensities are modulated by 
noise must ibe uniform over the field* and independent 
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of relative intensity. 

Staled mure specifically, the first assumption says 
that if I(Xj y) represents the intensity of the scene over the 
field of view, D; then the intensity received by the optical 
input device in the absence of noise is r 


I* {x t y) = /l(x -u, y -v )f(u, v) dudv 
]> 


for spine blurring function f{x, y). 

These assumptions are summarised in Figure 4, 4; 



IN TENSITY VALUES 
FROM OPTICAL 
INPUT DEVICE 


“L_J L- 

ACTUAL INTENSITY 


blurred INTENSITY 


*■■■»■ *■ r. ■ 

BLURRED INTENSITY 
WITH NOISE 


THE INTENSITIES OBTAINED FROM THE 
OPTICAL INPUT DEVICE ARE UNIFORMLY 
SUBJECTED TO BLURRING AND NOISE 


Fijgure 4. 4 









Some scenes analyzed by the program are shown in 
Figure 4. 5. 

It is easy to see that criteria 1. 2 and 1- 3 ere 
satisfied by scenes of this sort. However, it is not readily 
apparent that criterion 1, 1 16 satisfied. This follows from 
the fact that real lines such as highlights and cracits between 
cubes, in the absence of blurring and noise are never of zero 
width as stipulated in the definition of a line. However it is 
easy to see that they may be of nonzero width so long as they 
are sufficiently narrow to be indistinguishable from aero-width 
lines under the blurring function, This blurring function was 
discussed in Section II of chapter three, From its properties 
it is easy to see that blurred versions of lines of less than 
about five units width* where one unit is 1/2 000 of the 
vidissector field width* are virtually indistinguishable from 
each other and from blurred versions of lines of negligible 
width. Criterion i, 1 has thus been satisfied for these figures 
by keeping the apparent widths of the edge lines below the 
aforementioned five units. 

Criterion 2. 2 has been met by the optical input device 
used* an Information International vidiesector* by the nature 
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EXAMPLES OF SCENES ANALYZED 


Figure 4,5 




of its design. However certain care is required to satisfy 2. I, 
and it cart not be completely satisfied by the instrument used. 

The blurring inherent in the vidisseetor is a function 
of optical focus*. of internal electronic focus* and of the size 
of the internal aperture used to collect intensity data from a 
point in the visual field. The latter two matters have been 
discussed at length by Horn (Horn 1959), and in the literature on 
the instrument iteelf. Suffice it to say here that there is a 
more or leas uniform degree of blurring inherent as a result 
of these two factor s^ though a certain amount of non-uniformity 
is detectable by careful measurements. It is fortunate that the 
order of magnitude of these effects is somewhat greater than the 
optical blurring of the system when it is focused to minimize 
this blurring. By keeping the objects in Ihe field of view in a 
sufficiently flat plane, it is possible to have the non-optical 
blurring effects dominate the optical effects even for portions 
of the field which are relatively out of focus. This, to a first 
order of approximation* insures a uniformity of over-all 
blurring* despite the fact that the purely optical blurring is 
quite non -uniform. The criteria for "a sufficiently flat plane" 
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far the image is given by Laws of optics. From the well known 
relation that; 

l/F = 1/s + l/b 

Where; 

a = object distance 
b - image distance 
F = focal length of the lens, 

•it follows that; 

da/db = “ a 2 lb 2 . 

Hence for a given displacement Aa of the object from perfect 
focus, the image displaces by an amount -lAaXb 2 /* 2 ), This 
quantity, divided by the focal ratio f, gives the amount an image 
is blurred by die placing the object a distance Aa from perfect 
focus. Thus the allowable scene depth for a particular 
maximum allowable amount of blurring depends un the square 
of the scene-distance image-distance ratio; and inversely on 
the f-ratio. If a particular object nr arrangement of objects 
increases in absolute size, and its distance from the lens 
increases proportionately {and if the object distance is large 
relative to the lens-image distance), its image remains 
approximately constant in size, but the depth of the object 
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remaining in good focus increases linearly relative to the sisse 


of the object. It is thus possible* for a given arrangement of 
objects to keep the blurring over the whole field down below 
any pre-assigned limit by making the f-ratio sufficiently large, 
and by making the objects Sufficiently large. In practice, due 
to Lhe low sensitivity of the vidissector it was often impossible 
to insure adequate depth of field by the use of a suitably small 
aperture alone. In particular, in the case of the objects 
illustrated in Figure i. &, it was necessary to make an effort 
to make the objects as large as possible to satisfy criterion 2. 1. 

Ill, THE DETERMINATION OF FEATURE POINTS FROM 

INTENSITY INFORMATION 

In this section we will be concerned w r ith a discussion of 
a procedure for extracting information from a set of intensities 
taken over a visual field, as a first step in the determination 
■of the locations of lines in the field- The relevant theory, 
developed in the previous chapter, will be reviewed; and an 
algorithm for reducing intensity Information to "feature points" 1 
will be discussed. 

In applying the line predicate to various regions on 
the visual field, we shall obtain intensities along scan lines 




perpendicular Id the axes of the vi die sector. In particular we 
shall use intensities obtained from scans parallel to the x-axie 
in applying the line predicate to long rectangular regions 
oriented within + 45° of the y-axis. Similarly, whenever a 
line predicate is applied to a region lvithin +■ 45^ of the x-axis, 
intensities from scans parallel to the y-axi& will be used, We 
may thus henceforth without loss of generality assume that we 
are dealing with regions oriented u'lthin + 45 Q of the y-axis, and 
with intensities obtained from scans taken parallel to the x-axis, 
A scan shall consist of 500 intensities taken at Intervals of 
2 units along a line,, where, as In the previous chapter, one 
unit is I J 2000 of the full field width. The line ie centered 
laterally in the field, Kilty scans will be taken at intervals of 
2 0 units, with the 25-th scan half way up the field of view. The 
set of scans will thus encompass a square area exactly centered 
In the field of view, whose edge length is lOtiO units, or one 
half the edge length of the entire field of view, The reason 
far not using the entire field is simply that there are various 
physical problems at the edges, one of which involves an 
aperture which prevents obtaining intensity values at the corners. 


12 7 


Th« central Square ufied is approximately the largest useful 
(square region, in the field of view. For purposes of visualising 
the following explanations, it may be assumed that an entire 
sat of 25(10 intensities is obtained at once, prior to any further 
processing. This ls not entirely true, but may as ■well be 
considered to be the case. 

We will want to be able to apply the- line predicate to 
any of approximately fifteen million rectangular regions in the 
field of view. This figure is obtained from the fact that we 
are considering regions extending between pairs of scans, and 
the latter number &Q.-49/2 = 1250; we are considering regions 
at any of fifty orientations; and we are considering regions 
with any of 500 different intercepts. In fact, we shall appLy a 
modified version of tiie predicate to all of a subset of these, 
namely those which traverse the field entirely, which number 
SO §00 = 25, 000, This will be discussed in Section IV. Alec 
the predicate will be applied to shorter subregions of ihose 
among the latter which appear- to contain a line somewhere 
along their lengths. Further the predicate will be applied to 
regions proposed on the basis of lines already found. This will 
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be discussed! in Sections V, VI and VU. 

The application of to a region on the field of view 
consists in computing the value given by (3. 13): 

CUj]) + CE{ J^> 

■■ 1 —“— —*---c 

CUJj) + CFAJj) + enup 

where CL{J J j) is given by {3.29}, and CEO- 1 ) and CH(J^) are 
given by similar formula&r A region whose maximum minus 
minimum y-distance is k unite intersects with lie/2 Dlls can 
lines* where nil! means the closest integer to L Instead of 
assuming that a region is of a particular fixed width measured 
perpendicularly to its length, we shall assume it has a fixed 
x-direction width of 50 units. Consequently the intensities 
along a particular scan which lie within a rectangular region 
will be exactly 2.5 in number* since the separation of intensity 
points along a scan is two units. We snail also assume that 
the length of a sub-region, instead of being a fixed quantity 
an measured along the axis of a region* has a fixed y-direction 
length of 20 units. Also 5 ub-regions Will ue taken to be 
vertically centered on a scan line. Thie arrangement is 



diagrammed in Figure 4. 5- 


«-a 



We may thus identify a segment of a scan enclosed within a 
region with a particular sub-region. The advantages of this 
sort of geometry were discussed at the end of the previous 
chapter. We shall use a specific term for the segment of a scan 
which we are associating with a particular sub-region, namely 
a sub-region scan segment. In summary, a region of length 
a consists of II a/2 On - rn^aub-regions; and the value of Q* is 
computed from the m sub’region scan segments by calculating 
values of CL, CE, and CH according to formulas of the farm 
given by (3. 2 3). 

Evidently the intexisities of a particular sub-region 
scan segment enter into the computation of Q* for several 
thousand regions enclosing the segment, Examining (3. 29) 
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it is apparent that, e.g. , in computing CL, it is necessary to 

compute a value IT ^ from the intensities in this segment, and 

also a value a? ; mid that CL is determined entirely from these 
Jn k 


values, It is not hard to see that these values are the same for 

a particular segment, when the enclosing regions are all at the 

same inclination, Further, it was pointed out in some detail 

in the last chapter that these values for a particular segment 

do not vary a great deal with orientation of the enclosing 

rectangular region assuming, as we are, that the regions 

remain within + 45* of a normal to the scan lines. Thus, as 

before, only values of ft etc. , for two region orientations, 

inland 30° , need be computed- This is done, as in the previouE 

chapter, by using two paradigm profiles of different widths. 

Finally, we may recall that, at the end uf the previous chapter 

the procedure of computing a single value of Ft, R 1 , etc, , for 

a particular Segment and orientation was generalized to the 

computation of several, corresponding to different possibilities 

of the shape of the intensity profiles towa_rd the edge of the 

region. Consequently, for a given sub-region scan segment, 

we will compute exactly the values R. . Ft 

1 i,k p B 


a- 


hK 1 


a * , ' a - „ 1 ■ 
h^ t 6 J-k,l 


5 
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a"* , and also R/' and a 11 * , The blk R'S and a^'e are 

j.k, 5 j,k J*k 

computed as in (3. 25) and (3, 23) from six different peaked 
profiles (U^, ... U^), , (U^ . , , * of various widths 

and with various combinations of gradients towards the ends, 


Similarly the R 1! s and a'* r s are computed from five different 

cliff-like profiles- clearly, no such multiplicity is necessary 

in the cate of r' 1 and a |r ^, which corresponds to a homogeneous 

region. These paradigm profiles, £ 5-tuples of values (uj, 

25 

rr , , Uj ), etc. , from which the R’s, e*’s, R^'s* a'^'s, and 

R" and a"* are computed, are illustrated in Figure 4, 7. 

Since values of R. . ., a# , R 1 . . r , a r * 

hk, 1 ],k ; l j,k,5 j # k, 5 

R" . , and a'. f * will be required for every sub-region scan 
k Jj. k 

segment, they are all computed. Since there are 4 75*50 

sub-region scan segments, and 24 values computed per segment, 

this is a matter of 570* 000 intermediate values* an order of 


magnitude more than the 25,Q00 intensity values from which 
the values were computed. However* the derived set of 
values admits of considerable compactification. First, for 
a particular sub-region scan segment, it is necessary to retain 
only the minimum of all the R*s and R M s, together with the 
corresponding value of a* or a' 1 *. Secondly, consider the 
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_ I* 


paradigm intensity profiles used in computing Q 1 ** 

Figure 4.7 
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values of R" minus this minimal R or R 1 for the 475 successive 
sub-region scat] segments along a particular scan, Then there 
exists a threshold for these differences such that most valises 
lie below the threshold and indicate with virtual certainty that 
a line does not traverse a region containing that segment. 

Such values may be omitted, thereby indicating that they fall 
within this category. Also, only the local maxima of the values 
above threshold need be considered. Consequently an entire 
collection of 475 sets of values may be reduced to somewhere 
around ten seta. These latter sets need only consist of 4 
values; the value of R" minus the minimal R or R' which is 
locally maximal^ the value of a* or a 1 * corresponding to the 
minimal value of R or R. r ; an indicator aa to which R. or H 1 
was minimal; and the x co-ordinate of the point in question. 

Such a four-tuple, together with the y co-ordinate of the scan 
from which it was derived, will be termed a feature point. 

We will not justify in detail here why the 570, tltiO values can 
he reduced to approximately 5DtJ feature points. However we 
shall point out that the subsequent uae made of derived 
information in the computation, of Q* arid similar values uses 
no more than the reduced feature point data; that many of the 
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values can be considered to be in a single null category; and 
that the remaining values have Sufficient regularity to be 
specifiable in terms of their local maxima only. 

The program (GETFF X S) obtains intensities for a 
Single Sean and performs the calculations sketched above. 

The second argument is 1 or 0 depending on whether a scan is 
to be made vertically or horizontally respectively. The value 
of X is the appropriate ordinate or abcissa on a scale from 0 
to both Five hundred intensities are taken across the field 
along the line defined by the arguments and are processed 
according to the algorithm sketched above. The output is a 
series of 4-tuples as described above. A schematic diagram 
of this process appears in Figure 4. 

fn. the line finding program which has been developed, 
the sub-program GETFP is called 50 times for vertical scans 
and SO limes for horizontal scans, 'X'bia procedure is illustrated 
in Figure 4. 9. In this figure, the Short lints indicate the 
locations of maxima previously described. Their lengths are 
proportional to the corresponding values of Ft 1 ' - Min(R, R r ) 
for small values of this difference. For values of this difference 
above a certain threshold, a constant length of line is used 
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4 - path of scan 




( 580 , , ,, ( 550 , 

Y CO-ORDINATE 
X CO-ORDINATE 
R n - M1N(H, R't 
INDICATES EDGE 


Max(SUj), SE(j)^SH<j) 

= H" - Min(R, R 1 ) >< 


107J. E 21.) 


FINAL OUTPUT 


Msx(SUj), SE(j)> 
(= a* or a 1 *) 1 


SIMPLIFIED VERSION OF THE PROCESS OF EXTRACTING 
FEATURE POINTS FOR A SINGLE SCAN ACROSS THE FIELD 

Figure 4. & 
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- FEATURE POINT FOR A VERTICAL 
SCAN, LEFT END OF LINE IS ACTUAL 
LOCATION, LENGTH PROPORTIONAL 
TO R"-MinOL R'> FOR SHORT LINES. 

I FEATURE POINT FOR A HORIZONTAL 
SCAN. BOTTOM OF LINE IS ACTUAL 
LOCATION OF FEATURE POINT. 


FEATURE POINTS FROM SO VERTICAL AND 50 
HORIZONTAL SCANS 

Figure 4- S 
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corresponding to this threshold value. These points will be 
termed feature points, Rasters of feature points corresponding 
to the illustrations in Figure 4, 5 are given in Figure 4.10, 

IV, A GLOBAL PROCEDURE FOR EXTRACTING LINES 

FROM ARRAYS OF FEATURE POINTS 

If one were 1o examine the feature point rasters of 
Figure 4. 10, one would be able to pick out almost all tbs lines 
in the figures they represent. The perception of some of the 
lines may depend pn complex global perception processes, 
for exam pie * the use of obvious, lines to provide clues as to 
the existence of lees obvious ones- A computer approximation 
to this process wiLl be the subject of subsequent sections. On 
the other hand, some of the lines are obvious without either 
reierence to other parts of the figure or a priori knowledge 
of what constitutes a plausible figure. This is because the feature 

points are both strong (represented in 4 r L0 by long lines), and 
they Line up very exactly. This section describes a program, 
LINES, which takes advantage of the obviousness of certain 
lines to find them in an array of feature points, by a rather 
simple and not overly lengthy procedure, 
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FEATURE POINTS EXTRACTED FROM THE SCENES IN FIG. 4.5 

Figure 4,10 
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The prubLem of locating lines by accumulating locally 
obtained information has been approached by line following 
procedures, (Roberts) This often runs into the problem that 
the line follower gets lost, since, in effect, it is making a 
series of decisions (.whether or not to continue the l£ne) on 
the basis of lo-cal considerations. This problem becomes 
greater as the number of lines in the scene increases. Line 
followers are also subject to the problem of never having 
11 attached" themselves to certain lines in the first place. It 
is thus desirable to use a more exhaustive and global procedure., 
for example, covering the feature point raster with a very large 
number of narrow rectangles, and applying a thresholded 
predicate to the feature points within each rectangle- The 
apparent tremendous cost of such a procedure can be greatly 
reduced by observing that if a certain narrow rectangle contains 
evidence of a line, then so does a rectangle with the same 
orientation but extending across the entire field. The converse 
of this statement is not true, since a rectangle across the 
whole field may contain a Large amount of line evidence in the 
form of scattered noise and spurious values due to feature points 
along lines intersecting the rectangular region at some angle. 
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However, the testing af narrpw rectangles across the whole field 
does provide a sort of screening procedure. Any relatively 
strong lines will fall within at least one of these hands, and thus 
be detected. On the other hand, it is necessary to further analyze 
the contents of one of these bands which has a large amount of line 
evidence in It in order to determine both if there really is a 
line Within the hand; and if SO, where it is. 

The procedure for assessing the total amount of evidence 
for the existence of a line within a band is based on the idea of 
projecting a two dimensional array into a one dimensional line. 
For example, if an array of points (x. r y.) is given, and it is 
desired to determine the locations (x-intercepts) of vertical 
bands containing a large number of points, then it is merely 
necessary to histogram the x-co-ordinates of all the points. 

The resulting histogram has large values for x-intercept 
values of bands containing a large number of points. By this 
procedure, at] vertical bands are investigated in parallel. 

The procedure ls simply modified for arbitrary orientations, 
by histogram!tig numbers of points versus a quantity 
x^ + ay., where a depends on the orientation under consideration. 
This corresponds to projecting the raster of feature points onto 
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the x-axis at some angle. 

The program (FROJ % SL} carries oat this prelection 
procedure on an array of feature points X, projecting at an 
*ngie SL. The mam program calling PROJ uses iOQ values of 
SL. For 50 values, the feature points obtained from horizontal 
scans (parallel to the x-axis) arc used- The values of SL in this 
case correspond to orientations between + 45 degrees wilh the 
vertical (the y-axis). The remaining 50 projections use the 
feature points from the vertical scans, and involve angles 
between ± 45 degrees with the horizontal- The values histogramed 
aru not simply numbers of points, but sums of integer weights 
attached to the various feature points. These integers have 
values from 1 to 4 . and depend monotonitally on the value of 
K 11 - MiniR, Ft'). the first feature point value, for a particular 
point. Thus, for a particular band, it is not simply the quantity 
of feature points within it that is considered, bat something 
approximately equal to the sum of the values of R" ~ Min(R, R’> 
for points within it. This gives extra weight to distinct lines, 
and may be shown to approximate Q* in some sense. The value 
returned by (FROJ X SL) is the set of x-intercepta of centerlines 
of bands of slope SL which have a large amount of line evidence 
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til them. The algorithm employed by PROJ is diagrammed in 
Figure 4.11, 

The set of outputs of (PROJ 5S SL.) must be analyzed to 
extract the actual linefi in the scene. One problem which must 
he taken into account arises from the fact that a particular' set 
of feature points may give rise to an intercept value in the 
output of' several applications of PROJ, for successive values 
of si-.. This Is a result oi the fact that a given set of feature 
points which fall in aline along the visual field ace contained 
within sever elI rectangles of almost identical elopes. Another 
problem is that the output of PROJ contains a large number of 
false-positive values due to spurious effects described 
previously. 

The program] LIMES„ which calls PROJ for various 
values of the arguments, takes these factors into account by a 
complex process of: 

1 ) retrieving the feature points in sets from areas 
suggested by the output of PROJ* 

2) eliminating sets which do not actually constitute lines, 

3 ) eliminating spurious points from sets which do represent 
lines. 
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OUTPUT: 

(, »,<*»,,,*' (24D. 6, ) } 

SIMPLIFIED DIAGRAM OF {FROJ X SL) APPLIED TO 
X, A SIMULATED FEATURE POINT RASTER, AND 
SL, A SLOPE CORRESPONDING TO f IN THE DIAGRAM, 


Figure 4,11 
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4 ) 


5 of ting by the apparent strength of lines* 

5} eliminating redundant seta of points by considering the 
set in the order imposed by step 4 and eliminating sets 
which are highly redundant with {more distinct) sets 
which had previously been considered, 
fitting lines to the resulting sets of points. 

The output of (LINES X) is a set of lines retrieved from the set 
of feature points X. LINES is applied once to the feature points 
from the vertical seajij and once to the feature points from the 
horizontal scan. The result of applying LINES to the sets of 
feature points illustrated in Figure 4. 10 is shown in Figure 4. 12, 

V\ LINKING LINES TO FORM PARTIAL FIGURES 

Having Located a certain number of lines in a scene by 
the methods of the previous section* a logical ne*t step is to 
join them together and form figures. This may be viewed as a 
terminal step, provided all lines have been located by the 
projection procedure. This would not, in general* be the case; 
and the joining procedure described in this section is actually 
a first step in the location of the remaining lines of the figure. 
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OUTPUT OF LINES# APPLIED TO THE FEATURE POINT 
RASTERS IN FIGURE 4. 10 

Figure 4,12 
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We shall assume that the output of LINES, when applied 
-to & a at of feature points, does not include all the lines of 
interest in the original scene. This is, in fact, the case for 3 
out of 4 scenes in Figure 4. 13. It is a reasonable hypothesis 
that the lines found, together wiLh some assumptions about the 
nature of the scenes examined, provide some clues as to the 
locations of the remaining lines. It appears not to be the lines 
individually which, suggest the locations oi other lines, hut 
rather collections of lines which form a figure which is 
incomplete relative to a model o-f how the actual figures appear. 
An example is shown in Figure 4. 13, 



THE SOLID LINES HAVE BEEN IDENTIFIED, 

THE DOTTED LINE IS SUGGESTED BY THEM. 

Figure 4. 13 

It would be desirable to join the lines into groups which would 
suggest the possible location of other lines, A line verifier 
eould then be applied to the locations suggested. This 
procedure requires that all locations of missing lines ultimately 
he proposed. Otherwise, some lines would never be found by 
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either procedure - It is thus important that the whole mechanism 
for line proposing be liberal in proposing lines. Any excess lines 
proposed Will almost certainly be rejected by a suitably powerful 

verifier. 

Prior to the application of the linking procedure, a 
merging procedure is applied to the lines. This is necessary 
to eliminate redundant lines from two soui ces. 

1) Lines which are at approximately at a 45-degree angle 
with the vertical, and appear in the output oi LINES 
applied to both the vertical and the horizontal scans, 

2 ) Single lines which appear, for one reason or another, 
as a pair of contiguous lines in the output of LINES. 

The criterion for merging lines is given in Figure 4. 14. 


d < 10 and ^ < 10“ 



CRITERIA FOR MERGING LINES 

Figure 4. 14 
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It two lines are to be merged by this criterion, the pair is 
replaced by a single line which best I its the endpoints qf the 
two original lines. 

The joining procedure consists in applying directed 
links from one line to another. There are four possibLe types: 

U Regular links, denoted by the Symbol T. If suty part of 
line B lies within a neighborhood of radius 10 units 
around A, then A is given a directed T-link to B. 

This is illustrated in figure 4. 15. 

2) Extension Jinks, denoted by the symbol E. II any pari 
of line B lies In a particular region near the end of A, 
or if the end of line B lies within another more distant 
region extending away from the end of line Aj then an 
E-link from A to B is established. These regions are 
illustrated in Figure 4. 15. The motivation for this type 
of link is dial possibly a segment of A extending to B, or 
a longer augment extending to the end of B, has been 
•omitted. The reason lor pustulating a rather long 
extension to the end. of another line la that a line r a 
end, lining up with a given line, provides slrong 
evidence that the original line may actually extend to 
that eod, 
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EXTENSION-LINK REGIONS 
REGULAR LINK REGION 








LINE A 



regular lint 



I ini; 

pailPMe lirtL 


A LINK IS ESTABLISHED FROM LINE A 

TO LINE B ON THE BASIS OF TIIE INTERSECTION 

OF B WITH CERTAIN REGIONS AROUND A 

Figure 4,15 

3) Passive regular links, denoted by PT, If line B links 
to line A by a T-link, but A does not link to B by either 
type of link, then a FT-link is established from A to B- 

4] Passive extension link, denoted by pr. This is. similar 
to a PT-link, but is applied if B links to A by an E-link. 

ISO 











Ail illustration of the links applied to one of the sets of 
lines from Figure 4, IS is given in Figure 4, 16. It should be 
emphasized that, in accordance with the necessary liberal 
policy underlying the proposing of lines, the lines are oyer-linked. 
These links are not intended to be those applied when all the lines 
have been located. 

VI. HEURISTIC LINE PROPOSING 

This section describes the program APROPOS X}, which 
proposes additional lines from a possibly incomplete set X of 
lines from a scene. Each line is considered, in turn* and 
additional lines suggested by it, and by lines linked to it, are 
proposed. A verification program* to be explained in the last 
section* is applied to each proposed line. If the verifier claims 
that the line actually exists* it is added to the list of lines, 
together with links between it and other lines; and it may be 
used subsequently in proposing further lines. When no more 
lines ean he proposed from the {possibly augmented} set of lines, 
PROPOS returns the entire set, 

The proposing procedure is based on the premise that if 
a line is missing from a set S, then at least one line having a 
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LINKS BETWEEN MEMBERS OF THE OUTPUT. OF LINES 


Figure 4. lfi 
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common end-point with the min sing line is in the 6et X, or can 
be sLieces3fully proposed from X, This Ls illustrated i.n 
Figure 4. L7." It is further assumed that vertices have no mure 



IT IS ASSUMED THAT IF A LINE OF THE 

original figure was not among those 

OUTPUT BY LINES, THEN AT LEAST ONE 
LINE CONNECTING TO IT WAS* 

Figure 4.17 

than three or possibly four lines radiating from them, it 
follows Lhat lines should be proposed from the ends of lines 
already found, provided that there are not already many lines 
incident with a particular end. 

It is in general net entirely clear where a line generated 
by LINES actually terminates. This is partially due to the 
rough "mesh 1 of the scanning gridj and partly due to the fact 
that the feature point generator gets confused in the neighbor hood 
of a vertex. In order to propose lines from the ends of known 
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lines, it is necessary to make a reasonable estimate as to 
exactly where the ends lie, The first step in proposing lines 
from a given line is to dispose of the ends in the following 
manner: 

D If two lines intersect within ten. units of the end of a given 
line, the point on the line (possibly extended) closest to 
the intersection is taken as the end or “terminus 11 . 

2) If a terminus is not determinable by criterion 1, but a 
line intersects the given line within 25 units of the end, 
this intersection is taken as the terminus, 

3) If no terminus can be found by 1 or 2, that end of the 
line is said to be of "indeterminate terminus, 11 

The determination of termini is diagrammed in Figure 4. IS. 

Another assumption made by PRQFOS, which is 
independent of the first, is thaL the opposite a id eg of faces of 
the figures are approximately parallel, Ef it is desired to 
propose a line extending, e. g. , downward from the left 
terminus of a horizontal line, the direction of the proposed 
line is then the same as that of another "secondary" line 
extending downward from the given line, in particular, this 
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t- 4 —* 

if <*25 

F 

i 

1 terminus 

the "termini'’ of the horizontal 

LIMES ARE AS INDICATED. 

LINES PROPOSED FROM THE HORIZONTAL 
LINES EXTEND FROM THE TERMINI. 


Figure 4, 13 

'secondary" line should be the first line '’to the right" of the 
Left terminus, as that is the obvious candidate for am opposite 
side to the proposed one. This determination of these secondary 
lines, termed "directors" is diagrammed in Figure 4. 1ft. 

Having determined the termini and directors for a 
particular Lina, the procedure for proposing lines from a 
particular end is governed by four esses: 

1) The end of the line ie of undetermined terminus; 
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UPPER DIRECTOR 
FOR LEFT END OF A 



LINE "'A 1 '-* 


LOWER DIRECTORS 


FOR LEFT END OF 


LINE A 





NOT DIRECTORS 
FOR LEFT END 
OF LINE A 


DIRECTORS ARE LINES WHOSE DIRECTION 
SUGGESTS The DIRECTION OF A MISSING LINE , 


Figure 4. 1 & 

2) Only one line intersects with the given line at the 
selected end; 

3) Two lines lying on the same side of the given line 
intersect the selected end; or 

4) Something else occurs at the selected, end. 

In the first case lines are proposed from cither side of 
the original line for which a director has Peer found. Three 
parallel lines are proposed,, 10 units apart, parallel to the 
director, and with the end of the middle line coinciding with 
the indicated end of the given line. The other ends of the 
proposed lines are determined in this case, and in the cases 


156 









which follow,by making the proposed line no longer than the 
director, and truncating it so that it does not intersect any other 
Lines in the set. In case 21, lines are proposed on the opposite 
side from the intersecting Line, provided a director exists on 
that side. Three lines are proposed ten degrees apart, all 
extending from the terminus. Their lengths are determined 
as above, and the middle line is again parallel to the director. 

If no lines arc found on the aide away from the intersecting line, 
then lines are similarly proposed on the same side an the 
intersecting line, subject to the additional provision that the 
proposed lines all lie between the intersecting line and the 
director. If this were not the case, it would be impossible that 
the proposed line and the director he opposite sides of a face, 

Jn ease 3), lines are proposed similarly to the first set 
described for case 2). In case 4), no lines are proposed, 

These esses are diagrammed in Figure 4,20, 

In summary, PRQPQS goes down the list of linked lines 
proposing in the manner described above, adding lines which it 
finds -O the end of the list. This procedure is applied to the 
resulting list, and so on untiL no lines on the current litt result 
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i) LOWE ft TERMINUS OF "A” IS UNDEFINED* 

PARALLEL LINES PROPOSED; 

DIRECTORS FOR 
LOWER END OF "A' 1 



- PROPOSED 
LINES 


2) ONE LINE INTERSECTS LOWER END OF "A 1 ', 
RADIAL LINES PROPOSED; 


LINE "A 11 
LINE "B" 


o TERMINUS 

-PROPOSED 

LINES 


\ 


PROPOSED LINE TRUNCATED BECAUSE OF "B 


3) TWO LINES AT LOWER END OF ’’A" ON ONE SIDE, 
RADIAL LINES PROPOSED ON OTHER SIDE; 



c TERMINUS 

— “ - PROPOSED 
LINES 


4) LINES ON EITHER SIDE OF LOWER END OF ir A", 
NO LINES PROPOSED; 



PROPOSING OF LINES FROM AN END OF A GIVEN ONE 
IS GOVERNED BY FOUR CASES. 


Figure 4.2 0 
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in the proposing of any further lines. At this pointy the final 


Set of lines i£ returned by the program. The process of 
proposing lines is diagrammed in Figure 4. 2L 

VIL A LINE VERIFIER 

Line verification consists in applying the function 



in a region suggested by the line proposer. The region is 

assumed to be divided into it Square or nearly square sub- 

regions, andQ* or its variant is computed from the values 

R , ... > ft a* t ... , etc., according to Formulas 
J i A j ► J j 1. 

{3, 13} and {3, 29), or formulas derived from them. In most of 

the remainder of this Section we shall be concerned with a 

generalization of Q- : {Jj 1 ) which has been suggested by the 

discussion at the end of chapter three. This generalization 

consists in assuming that the values of ft . and R f are 

* h k Lk 

given by: 


R. , * Min(R 
J,k 



(4. 1) 


ft: . ■= Mintft 1 

b k j 


(4. 21 


1 b9 



THREE ADDITIONAL FINAL SET 

PROPOSING PASSES OF LINES 

diagram OF the process of line proposing, 

SMALL NUMBERS INDICATE TIIE ORDER OF PROPOSING. 

Figure 4.21 
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where the R. . 's and R ! 's are computed from the 25 
j* K-c t J, k, II 

intensities of the k-th sob-region scan segment according to 
(3. 25), and from the paradigm intensity profiles illustrated in 
Figure 4. *2. According to the discussion in Section III, the 
values in the feature point rasters are derived from the 
values given by (4. 1) and (4= 2), and the present line verifier 
draws upon exactly these values. In this section we shall 
review the relevant theory in detail, describe the present line 
verifier, and suggest possible improvements and generalizations 
of it. 

The present line verifier, in computing a variant of 

for a region, obtains the values of, e, g-„ R. . for 
3 it 

CL(j> of (3. 23) from the feature point rasters such as are 

partially depicted in Figure 4. 10. In principle, if the region 

encloses n 2a point sub-region scan segments of the original 

scans, then the values R. , etc. , should be computed from 

], K 

exactly these scan segments. These values were computed 
for all possible sub-region scan segments„ in the generalized 
manner given by (4, 1) and ( 4 . 2), by the feature point generation 
procedure. However, most of the values of the R's and R" S 


i g i 


were discarded! during the comp&otification process. In fact it 
was only locally maximal values, of 13, given by: 


E . * fi" , - Min(R , ,R’ , ) (4. 3) 

hk 3- k b k b k 

where R , and K 1 are given bv (4. 1 ) and (4, 2), that were 

L* ],k 

retained. However, it turns out that we may obtain a 

reasonable estimate of the value of E , for the intensities of 

]■ k 

a particular sub-region scan segment along a particular scan 

from one of these maxima nearby along the same scan. In 

particular, if E- is a desired value of E for a sub-region 
J. K 

A 

scan segment along some scan, then let E. be the value of 

J ^ 

E which is locally maximal along the same scan and Is computed 


from a sub-region scan segment closest to the one in question, 

We assume that there exists a maximum within something like 

15 units of the segment in question, else we assign E the 

ji n 

value 0, If E- , so defined actually exists* then the following 

Jj K 

re 1 ations hip holds: 

E E. . - ax 3 (4,4) 

j,k Ji k 

where £ is snme constant, and x is the distance between the 

A 

aub-region scan segments from which E. , and E. were 
computed This relationship follows from the behavior of the 
j£ curve In the neighborhood of a maximum, which maybe 
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observed Li Figures 3, S? and 3. UK It will be seen later that 

the n_ values of E. are all that are necessary to compute the 

present variant of Q* used in the line verifier. 

This present variant of Q- omits the second and third 

terms in the exponent of, e- g, , the value of CL as given by 

(3. 29), and thus does not need the values of a 1 * and 

j, k j, k 

*'j\' The middle term may be ignored because it turns out to 

be always very small relative to the other two. To see ibis, 

recall that line verification in. the present set of programs is 

applied only to lines, or possible Lines, which escaped 

detection by the LINES program. They are thus lines which 

have a net relative amplitude whose magnitude is small relative 

to the average magnitude of relative amplitudes for lines in 

general- One may observe that the denominator of the middle 

term is dominated by its third term, so the term is approximately 
2 « 2 

C £a'i : u /n)/p , This is approximately the square of the net 
ft. J# K *1 

amplitude divided by its variance. Since the net amplitude 
in situations under consideration is small relative to the 
average magnitude of the net amplitudes, and the average net 
amplitude over lines jn general Is afro; then the net amplitude 


Ls am all reLative to its standard devlatiQn- The second term of 
(5. 29} la thus in this case very smell, being approximately the 
square of the quotient of the net amplitude with the standard 

deviation. 

The omission of the third term of the exponent of (3,29) 
was baaed on the empirical observation that for the majority 
of the scene a analyzed, this value seemed not to be related In 
a reliable way to the existence of lines A series of experiments 
was began to properly lest whether any such relation existed. 

The results appeared promising but. not so iar conclusive. 
Consequently the third term was omitted pending further 
investigation - 

Tbe resulting variant of Q*U is quit* similar to the one 
discussed at the end of the previous chapter. It is given by (3, 13), 
where the various values, e. g ., of CL are given by (3. 29) but 
with only the first term in the exponent. This was the case in 
the situation described in the end of chapter three. Also, this 
time we expect a scan of 500 points to intersect with about five 
lines in the visual field, so the relation between P(CU. P(CE) 
and F(CH) remain* approximately the same as in the situation 
at the end of chapter three. Finally, we may ^ before 
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assume that one of the terms in the numerator is considerably 
larger than the other. Thus by an argument similar to that 
used in deriving (3. 41) and {3. 43) we arrive at the function 
Q'^CJ j) defined by; 


TL 



where, e, g, , SL^fj) is like SL.(j) given by (3. 3T") with subscript, 
k in place of 1. As before, this function is approximately 
monotone in Q’M J^) and hence thresholding it provides an 
approximately Sub-optimal regional decision predicate. One 
may see from (3, 3 7), (3,33), (3.39), (3.23), (3,24), (3 25) 
and a certain amount of algebra that: 

SL^j) - Myjl ■ Rj‘ k - R- ,, 

and 

S E k (j) - SH^j) - R" k - R i<k . 

Using (4 3) we may rewrite (4, 5) as; 

n 

a TV t + K, (4.6) 


with the values of E. . obtainable via (4. 4} from values 


E t which are available In the feature point raster. In 
J, K 
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(4.7) 


summary we have: 

^ ^ Ej k - **t * K ‘ 

recalling that if & suitably close feature point for obtaining a 
value E. . did not exist, then the corresponding . w&s 

j* ^ 

assigned the value aero. 

in practice it was found to give better results to 
deviate slightly from a strict thresholding of (4. 7) in the 
verification of lines. Prior to applying (4. 7) to a region it was 
observed which of the E, , were given nonzero values. In the 

Jj* Vu 

case that the locations of the nonzero E 'b were sparse or 
concentrated in one place in the region, the thresholding 
procedure was omitted, and a negative answer was returned 
as t.o the exigence of a Line. This is approximately the same 
as observing the pattern of the locations of feature points within 
the region, and denying the existence of a line if they are all 
clumped together or are sparsely scattered within the region. 
These two situations are usually due to the existence of feature 
points from lines that cross the region at non -negligible anglee. 
Another variation from (4. 7) Which was found to bE> more 
convenient, and in some cases more accurate, was to 
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A 2 

threshold the sums of the Ej -.'s and the aunts of the x^'e 


separately. Fin ally , Instead of taking x, to he the deviation of 
A 

the E. .. feature point from the center of the region, it was taken 


A 


to be the deviation of the E. feature point from a best ■'fit line 

Jj- it 

A 

to the various E feature points. 

The line verifier (VERIFY PI P2) takes an arguments 
the end-points PI and P2 of the proposed line and outputs 


either NIL, if the line is thought not to exist by the above 
criterion; or the end-points of the best fit line to the feature 


points if the line is considered to exist. 

in observing the line verifier in action in Figure 4. 31, 
occasional failures are apparent. Although no lines are claimed 
to exist which do not exist in the figure, several ectually 
existing in the figure were proposed but claimed, on the basis 
of the feature point, raster information, not fo exist by the 
verifier, An examination oi the feature point raster indicates 
the presence of feature points in these regions. The problem 
was principally that the region intersected with too few scans, on 
the order of three to five; giving too few values for the threshold 
function (-4. 7) to work with. Evidently a finer scan would 
eliminate this problem, as well as some other approaches to 


its improvement which are about to bo disoussed- 

A major source of improvement for the line verifier is 
for it to obtain a new Set of intensities within the region to which 
it is applied,, at considerably higher density than that of the 
original scan- This would eliminate the difficulty described in 
the previous paragraph, would allow more accurate values of 
the it r Sj E's or whatever, to be obtained, and would eliminate 
the necessity of the approximation to the e'j ^’s in {4, 4). 

Another improvement would result from the utilization of the 
third term of {3. 2 9) and Similar expressions- A.p was Staled 
previously, investigations in this area are still under w&y. 

It seems plausible that the model in Section IV of chapter three 
may have to be modified in assumptions 4) and 5) to admit of a 
regular linear variation of "idealized" relative amplitude along 
a noise-free ridge-like or cliff-like noise-free sample. 


CHAPTER 5 
RELATED WORK 

I. OTHER APPROACHES TO LIRE FADING 

An early line-finding program was written by Roberts 
(Roberts), This program analysed photography of good 
contrast and focus, of Scenes whose content was principally 
defined by straight edge-line Sr Feature points were obtained 
from a predicate on four adjacent intensities of a 2 by 2 square 
on the visual field- Feature points were organized into lines 
by a sort of line-following procedure. Higher level heuristics 
handled ibe resulting lines, 

A comparison mey be made between the behavior of 
Roberts' four-point feature point predicatej and the present 
feature point gathering procedure. This analysis is a 
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genersdLzation of a procedure due to E inford and Hers^ovits 
fHerskovits), 


An upper bound on the performance of the former may 
be inferred from theoretical considerations. Data on the actual 
performance is not available. The feature point predicate le 

applied to intensities x. ^ * i+1 ^ *1+1, j+l at fQUr 

adjacent poinLs in a square pattern ona25$by25& point grid. 

The threabolded value is; 


=t,j ■ j"^i+lp j,+l^ 3 + ^M-l, j'ft, j+1* ' 


where 


Assume that the noise is gaussien, and that the noise level, as 
measured by the standard error about a mean of values of jr 
taken at a single point under constant lighting conditions, is s 
for intensities in the vicinity of the average of the four y f s in 
question. It is not difficult to show that z as a function of tine 

random variables y % y y i+lj y J it j+i &nd ^i+l, j+i has & 
median of about 3a, and an upper interquartile point value of 
about 3s In the context of the set of figures we are considering, 
one would expect about one feature point per 100 quadruples of 
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intensity. Thus fur about 50% false positives,, one would wish 
to set the threshold on ss high enough that a falls above threshold 
by chance once in 10D times. For a normal -distribution, tills is 
about 2- b standard deviations, which corresponds to3 times the 
semi-interquartile range, ’Thus z should cut off at about 5a. 

Now it is not difficult t.o sec what values of z_ would result for 
various lines and edges of amplitude a. oriented in various ways 
with respect to the grid of squares, in Figure 5. 1 we have 
computed such values for 12 cases, In the diagram , we are 
assuming that the dimensions of the blurring function arc Such 
as to give the line and edge profiles of the width shown. This 
width appears to be about an optimum compromise, if 
considerably lower then more edges would have a relatively 
high s-value, but more Lines would have a zero z-value. As 
the width increases, both lines; and edges tend toward having a 
zero z-value. From the diagram it may be estimated that the 
average value of z fur edges is about „ Ba, and for lines about . J ia- 
Thus the amplitudes of lines and edges respectively which are at 
threshold are about 6. 3s and 12. ds. This may be compared 
with the values 1. 2 s arid 2 s obtained for Q* at the end of 
chapter three. The difference is due to two factors. First, 
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the Roberts predicate has a support of only four points, whereas 
the Q± tested had a support of 25 points. One would expect the 
signal to noise ratios to differ by a factor ol yj2 5 /' 4 = 2-5, 

The actual difference is about 5* and the remaining factor of 
two is probably due to the fact that the Roberts predicate io 
isotropic, whereas Q* is directional. 

The TopologisL, baaed on the work of Binford. Sue aman 
{Sussrnan) and Herakovits (Ilerskovits), represents another 
approach to the analysis of simple scenes. In this case, the 
scene is divided into a set of small square regions which are 
individually tested for homogeneity. Adjacent homogeneous 
regions are clustered into maximal homogeneous regions, which 
are presumably the areas of the scene which lie between edge 
lines. This procedure has the properties that edge lines need 
not be straight, and that arbitrarily complex predicates for 
homogeneity may be used. 

Recently, a method of spatial frequency filtering and 
matching has been applied to the problem of location of feature 
points {Ilueckelh This procedure is roughly a two dimensional 
version of the feature point analysis presented here. For a 
circular neighborhood, an estimate is given of the directional 
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and amplitude parameters of a possible edge through the 
neighborhood, This procedure fieuiriE to be bated on a rather 
simple model of the nature of intensity profiles at edges. Also, 
it fit-tms to be relatively insensitive to the presence of lines. 

An approach bearing some mathematical similarities to 
the feature point detection procedure reported here* was 
employed by Saunders (Saunders) in an analysis of filmed 
images of scope tracings. In this case it wae necessary to 
locate the intersections with parallel Scan linos of the imago of 
& narrow trace along the film. 

Worthy Of mention here, though not specifically related 
to line finding, is the work in statistical decision theory of 
Chow (Chow). The theorem in the first chapter is essentially 
an adaptation and generalization of Chow's results in the theory 
of optimal error reject trade-off. 

II, RELATION OF THE PRESENT WORK TO TLIE 

DEVELOPMENT OF a VISUALLY ORIENTED REAL- 
TIME OBJECT MANIPULATOR 

The program here described is part of a Larger effort to 
develop the visual-perception aspects, of a real-time object 
manipulator. (MAC Progress Report 196B) For the present. 
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effort has centered on programs to obtain descriptions of scenes 
composed of cubes and other prismatic solids. By a description 
of an object is meant a list of the spatial co-ordinates of its 
verticesj together with a List of pairs of vertices defining edges 
of the object. By a scene description is meant a list of object 
descriptions., one for each object in the seene. 

There is an obvious disparity hetween the output of the 
present program and a corresponding scene description. The 
former is., or can easily he reduced to, a set of vertices and a 
set of vertex pairs representing edge lines, A description 
requires that these vertices and vertex pairs be grouped Into 
sets corresponding to the various objects in the scene. One 
may regard the output of the current program ae a set of lines 
dividing the field into regions. The problem then, becomes one 
of grouping regions which correspond to faces of a single object, 
and matching regions which may be parts of a single face which 
has an occluding object In front of it which divides It into two 
regions. This problem has been investigated in detail, and a, 
program called SEE (Guzman) performs the described grouping 
and matching to reduce the output of the present program into a 
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proper two dimensional scene description. 

Several approaches to the problem of determining the 
locations of objects in three dimensions have been investigated 
In greater or lesser degrees of detail. One suggestion involves 
the uae of two light sources located close to the point of view of 
the optical input device. One would be a point source,, whose 
intensity falls off as the square of the distance from the point of 
view. The other would be a source placed M at Infinity" by means 
of lenses, whose intensity would fall off negligibly with intensity. 
If illumination is rapidly alternated between these two sources, 
and intensities ohtaimed for a particular point under both 
conditions, the relation between the two intensities would yield 
the distance from the point of view to the point in the field. 
Another approach to determining the distance from the point of 
view to a point in the scene involves the use of optical focusing. 
(Horn 1968) By this procedure, a point in the scene is brought 
into perfect focus and the position of the lens of the optical input 
device is transmitted to the computer. After a suitable 
calibration procedure, the absolute distances of objects may thus 
be obtained automatically. A third approach (Horn) involves the 
use of intensity gradient to infer the shape of the contour of a 
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curved surface. By this technique, relative distance information 
may be obtained for points on curved surfaces. A final approach 
worked out by the present author, involving an analysis of the 
scene from two different pninta of view, relates directly to the 
current work. It is assumed that the present program has 
examined a suiLable scene from two different points in space, 
and that the resulting two sets of lines have been processed by 
SEE. Central to this approach is a subroutine called WHERE 
which is based on results in projective geometry, and ie 
described in a recent Project MAC Artificial Intelligence Memo 
{ Minsky). This program takes as input the two dimensional 
co-ordinates of a point from each scene. In many cases, WeIERE 
can determine that the two point# are not images of the same 
point in space If the points are from the name point in space, 
WHERE outputs the three-dimensional co-ordinates of that point, 
One might apply this program in a straightforward manner to a 
point in nne scene together successively with all points of the 
other. This would greatly reduce the possible "matches’ 1 of 
features in the two scenes, but would, in general, not suffice lo 
determine Lhe three-dimensional locations of all the vertices, 

The problem of resolving the remaining ambiguities, as well as 
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developing a more efficient point - m at c hi rig procedure seems to 
be quite complex. It seems Likely that the organisation that 
SEE imposes in the lines would provide a basis for using 
contextual clues to match the vertices. The problem is currently 
under investigation. 

A final problem worthy of mention is that, of the 
determination of the stability of a configuration of prismatic 
solids, given a three-dimensional scene description of it. 

(Blum} The relevance of this problem derives from the fact 
that it is one of the goals of the object manipulator project to 
be able to construct structures from rectangular blocks. In 
order to direct the object manipulation device, a program 
must first determine the order In which the blocks are to be 
set down. It may be possible to construct a sub-configuration 
of the desired configuration which has the property that adding 
any additional block results in an unstable configuration. To 
forestall such a possibility, it is necessary to be abLe to 
delect instability in searching for an appropriate order in which 
to build the structure. 
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